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Chapter 1 

Introduction 

1.1 Preliminaries 


Definition (Differential equation) 

A differential equation (de) is an equation involving a function and its deriva¬ 
tives. 


Differential equations are called partial differential equations (pde) or or¬ 
dinary differential equations (ode) according to whether or not they contain 
partial derivatives. The order of a differential equation is the highest order 
derivative occurring. A solution (or particular solution) of a differential equa¬ 
tion of order n consists of a function defined and n times differentiable on a 
domain D having the property that the functional equation obtained by substi¬ 
tuting the function and its n derivatives into the differential equation holds for 
every point in D. 

Example 1.1. An example of a differential equation of order 4, 2, and 1 is 
given respectively by 

(^) + ^ + y = 2sm(x)+cos 3 (x), 

d 2 z d 2 z _ 
dx 2 dy 2 

yy' = 1- * 


1 
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Example 1.2. The function y = sin(x) is a solution of 

(itc) + ( ^ + y = ‘ 2sin ( x ) + cos3 ( x ) 

on domain R; the function z = e x cos (y) is a solution of 

d 2 z d 2 z _ 
dx 2 dy 2 

on domain R 2 ; the function y = ‘l^fx is a solution of 

yy' = 2 


on domain (0,oo). * 

Although it is possible for a DE to have a unique solution, e.g., y = 0 is the 
solution to {y') 2 + y 2 = 0, or no solution at all, e.g., (y 1 ) 2 + y 2 = — 1 has no 
solution, most De’s have infinitely many solutions. 

Example 1.3. The function y = \/4a : + C on domain (—C/4, oo) is a solution 
of yy' = 2 for any constant C. * 

Note that different solutions can have different domains. The set of all 
solutions to a de is call its general solution. 


1.2 Sample Application of Differential Equations 

A typical application of differential equations proceeds along these lines: 



Real World Situation 



1 



Mathematical Model 



1 


Solution of Mathematical Model 

1 


Interpretation of Solution 
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Sometimes in attempting to solve a de, we might perform an irreversible 
step. This might introduce extra solutions. If we can get a short list which 
contains all solutions, we can then test out each one and throw out the invalid 
ones. The ultimate test is this: does it satisfy the equation? 

Here is a sample application of differential equations. 

Example 1.4. The half-life of radium is 1600 years, i.e., it takes 1600 years for 
half of any quantity to decay. If a sample initially contains 50 g, how long will 
it be until it contains 45 g? * 

Solution. Let x(t) be the amount of radium present at time t in years. The rate 
at which the sample decays is proportional to the size of the sample at that 
time. Therefore we know that dx/dt = kx. This differential equation is our 
mathematical model. Using techniques we will study in this course (see §3.2, 
Chapter 3), we will discover that the general solution of this equation is given 
by the equation x — Ae kt , for some constant A. We are told that x = 50 when 
t = 0 and so substituting gives A = 50. Thus x = 50e kt . Solving for t gives 
t = ln(a;/50) /k. With a:(1600) = 25, we have 25 = 50e 16OOfe . Therefore, 


1600/c = In 



-M2), 


giving us k = — ln(2) /1600. When x = 45, we have 

, MM50) ln(45/50) ln(8/10) ln(10/8) 

k — ln(2) /1600 ln(2) ln(2) 

« 1600 • « 1600 x 0.152 « 243.2. 

0.693 

Therefore, it will be approximately 243.2 years until the sample contains 45 g 
of radium. 0 

Additional conditions required of the solution (a;(0) = 50 in the above ex¬ 
ample) are called boundary conditions and a differential equation together with 
boundary conditions is called a boundary-value problem (BVP). Boundary con¬ 
ditions come in many forms. For example, y( 6) = y( 22); y'(7) = 3y(0); y( 9) = 5 
are all examples of boundary conditions. Boundary-value problems, like the one 
in the example, where the boundary condition consists of specifying the value 
of the solution at some point are also called initial-value problems (IVP). 

Example 1.5. An analogy from algebra is the equation 


y = y/y + 2. 


(1.1) 
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To solve for y, we proceed as 

y - 2 = y/y, 

( y — 2) 2 = y, (irreversible step) 
y 2 - Ay + 4 = y, 
y 2 - 5y + I = 0, 

(y - 1) (y - 4) = 0. 

Thus, the set y € {1,4} contains all the solutions. We quickly see that y = 4 
satisfies Equation (1.1) because 

4 = + 2 => 4 = 2 + 2 => 4 = 4, 

while y = 1 does not because 

1 = \/T + 2 => 1 = 3. 

So we accept y = 4 and reject y = 1. * 



Chapter 2 

First Order Ordinary 
Differential Equations 


The complexity of solving De’s increases with the order. We begin with first 
order de’s. 


2.1 Separable Equations 

A first order ode has the form F(x, y, y') = 0. In theory, at least, the methods 
of algebra can be used to write it in the form* y' = G(x,y). If G(x,y ) can 
be factored to give G(x,y) = M(x) N(y ),then the equation is called separable. 
To solve the separable equation y' = M(x)N(y), we rewrite it in the form 
f{y)y' = g(x). Integrating both sides gives 

J f{y)y'dx= J g{x) dx, 
j f(y)dy = j f(y)^ dx. 

Example 2.1. Solve 2 xy + &x + (x 2 — 4) y' = 0. * 


*We use the notation dy/dx = G(x , y ) and dy = G(x,y) dx interchangeably. 


5 
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Solution. Rearranging, we have 


( x 2 - 4) y' 

y' 

y + 3 
ln(|y + 3|) 
ln(|y + 3|) + ln(|a: 2 — 4|) 


—2 xy — 6x, 


—2 xy — 6x, 


2x 

x 2 — 4’ 
— ln(|x 2 — 


x ±2 

4 | )+C, 


C, 


where C is an arbitrary constant. Then 


(y + 3) (x 2 - 4) | = A, 
(V + 3) ( X 2 - 4) = A, 



where A is a constant (equal to ±e c ) and x ^ ±2. Also y = —3 is a solution 
(corresponding to A = 0) and the domain for that solution is R. 0 


Example 2.2. Solve the IVP sin(x) dx + ydy = 0, where y(0) = 1. * 


Solution. Note: sin(x) dx + ydy = 0 is an alternate notation meaning the same 
as sin(x) + y dy/dx = 0. 

We have 


ydy = — sin(x) dx, 
j ydy = j — sin(x) dx, 

y 2 

Y = cos(x) + Cl, 
y = y / 2cos(x) + C 2 


where C\ is an arbitrary constant and C 2 = 2C\. Considering y{ 0) = 1, we have 

1 = y/2 + C 2 =>• 1 = 2 + C 2 =>• C 2 = - 1 . 

Therefore, y = y^cos^) — 1 on the domain (—7r/3, 7 t/ 3), since we need cos(x) > 
1/2 and cos(±7t/3) = 1/2. 
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An alternate method to solving the problem is 


ydy 



— sin(x) dx, 

r 

/ — sin(a;) dx, 


Jo 

cos(a:) — cos(O), 

cos(a;) — 1, 

eos(a;) - 
i/2cos(a;) — 1, 


giving us the same result as with the first method. 
Example 2.3. Solve y 4 y' + y' + x 1 + 1 = 0. 
Solution. We have 


0 

* 


( y 4 + 1 ) y' = -x 2 


where C is an arbitrary constant. This is an implicit solution which we cannot 
easily solve explicitly for y in terms of x. 0 


- 1 , 

- x + C, 


2.2 Exact Differential Equations 

Using algebra, any first order equation can be written in the form F(x , y) dx + 
G(x, y)dy = 0 for some functions F(x, y), G(x, y). 


Definition 

An expression of the form F(x, y) dx + G(x, y) dy is called a (first-order) differ¬ 
ential form. A differentical form F(x , y) dx + G(x, y) dy is called exact if there 
exists a function g(x, y) such that dg = F dx + G dy. 


If co = F dx + G dy is an exact differential form, then to = 0 is called an exact 
differential equation. Its solution is g = C, where lo = dg. 

Recall the following useful theorem from MATB42: 
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Theorem 2.4 

If F and G are functions that are continuously differentiable throughout a 
simply connected region, then F dx + G dy is exact if and only if dG/dx = 
dF/dy. 


Proof. Proof is given in MATB42. 


□ 


Example 2.5. Consider (3a : 2 y 2 + x 2 ) dx + (2 x 3 y + y 2 ) dy = 0. Let 
to = (3 x 2 y 2 + x 2 ) dx + (2 x 3 y + y 2 ) dy 


Then note that 


dG 


dF 


= Q X y = 

ox ay 


By Theorem 2.4, to = dg for some g. To find g , we know that 

9g q 2 2 , 2 

— =3x y + x , 
ox 

= 2 x 3 y + y 2 . 
dy 

Integrating Equation (2.1a) with respect to x gives us 


9 = x V + xr + %)- 


So differentiating that with respect to y gives us 


(2.1a) 

(2.1b) 


( 2 . 2 ) 


Eq. (2.1b) 

8y 

2 x 3 y + y 2 


dh 

dy 


h(y) 


2x 3 y + 


dh 

dy' 


2 x 3 y + 


dh 

dy' 


3 


+ C 
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for some arbitrary constant C. Therefore, Equation (2.2) becomes 

7*3 n .3 

9 = x 3 y 2 + Y + J +C - 

Note that according to our differential equation, we have 

dfx 3 y 2 + - 7 T + vr + C 1 ') = 0 which implies x 3 y 2 + ^— + ^- + C = C" 

\ o o J o o 

for some arbitrary constant C'. Letting D = C' — C , which is still an arbitrary 
constant, the solution is 


x 3 y 2 


x ° 

T 



* 


Example 2.6. Solve (3a : 2 + 2xy 2 ) dx + (2 x 2 y) dy = 0, where y{ 2) = —3. * 

Solution. We have 


J (3a ; 2 + 2 xy 2 ) dx = x 3 + x 2 y 2 + C 


for some arbitrary constant C. Since C is arbitrary, we equivalently have x 3 
x 2 y 2 = C. With the initial condition in mind, we have 


8 + 4-9 = 


C 


C = 44. 


Therefore, x 3 + x 2 y 2 = 44 and it follows that 

±\/44 — a : 3 


But with the restriction that y( 2) = —3, the only solution is 

\/44 — x 3 


on the domain (—-^44, v^44) \ {0}. 0 

Let u) = F dx + G dy. Let y = s(a;) be the solution of the DE to = 0, i.e., 
F + Gs'(x) = 0. Let yo = s(x o) and let 7 be the piece of the graph of y = s(x) 
from (xo,yo) to ( x, y ). Figure 2.1 shows this idea. Since y = s(x) is a solution 
to ix = 0, we must have tx = 0 along 7 . Therefore, f x = 0. This can be seen 
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Figure 2.1: The graph of y = s(x) with 7 connecting (xo,yo) to ( x,y ). 


by parameterizing 7 by y(x) = (a;, s(a:)), thereby giving us 

f u> = f F dx + Gs'(x) dx = f 0dx = 0. 

J 7 J Xq J Xq 

This much holds for any to. 

Now suppose that u> is exact. Then the integral is independent of the path. 
Therefore 

0= f lu = f F dx + G dy + f F dx + G dy 

J 7 J 71 *^72 

ry 


rv rx 

= / G(x 0 ,y)dy+ / F(x,y)dx. 

Jyn J Xq 


'VO j Xq 

We can now solve Example 2.6 with this new method. 

Solution (Alternate solution to Example 2.6). We simply have 
/*4 


fX 

2 • 2 2 y dy+ (3x 2 + 2xy 2 ) dx 
-3 J 2 


' —3 
..2 


= V - 4 (—3) + - 2 d - 2 V 

= 4y 2 - 36 + a : 3 + a.’ 2 y 2 - 8 - Ay 2 , 

finally giving us a ; 3 + x 2 y 2 = 44, which agrees with our previous answer. 0 
Remark. Separable equations are actually a special case of exact equations, that 


is, 


f(y)y' = g{x) => -g(x) dx + f(y) dy = 0 = 4 > Ef( y) =0=2- (~g(x)). 
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So the equation is exact. 


0 


2.3 Integrating Factors 


Consider the equation w = 0. Even if u is not exact, there may be a function 
I(x, y) such that Iu> is exact. So to = 0 can be solved by multiplying both sides 
by I. The function / is called an integrating factor for the equation w = 0. 

Example 2.7. Solve y/x 2 + 1 + y'/x = 0. * 


Solution. We have 


We see that 


d_ 

dx 


\ + l) dx H— dy = 0. 
x z / x 




1 

X 2 



So the equation is not exact. Multiplying by x 2 gives us 


(y + x 2 ) dx + x dy = 0, 

„3' 


dixy- 


= 0 , 


xy ■ 


= C 


for some arbitrary constant C. Solving for y finally gives us 


C 


y = 


X 

y 


o 


There is, in general, no algorithm for finding integrating factors. But the 
following may suggest where to look. It is important to be able to recognize 
common exact forms: 


xdy + y dx = d(xy ), 
xdy — y dx 


= d y - 


xdx + y dy 
x 2 + y 2 
xdy — ddx 


= d 


(!)• 

ln(;r 


x* 


y z 




a - 1 y b ~ 1 (aydx + bxdy) = d(x a y b ) . 
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Example 2.8. Solve (x 2 y 2 + y) dx + (2 x 3 y — x) dy = 0. 
Solution. Expanding, we have 

x 2 y 2 dx + 2 x 3 y dy + y dx — xdy = 0 . 
Here, a = 1 and 6 = 2. Thus, we wish to use 

d(xy 2 ) = y 2 dx + 2 xy dy. 

This suggests dividing the original equation by x 2 which gives 


y 2 dx + 2 xy dy 


■y dx — xdy 


= 0 . 


Therefore, 


xy 2 + - = C, x ^ 0, 
x 


where C is an arbitrary constant. Additionally, y = 0 on the domain ffi. is a 


solution to the original equation. 

Example 2.9. Solve y dx — xdy — (x 2 + y 2 ) dx = 0. 
Solution. We have 

y dx — xdy 

-—— - dx = 0, 

x z + y z 

unless x = 0 and y = 0. Now, it follows that 

— taiW 1 ^ —^ — x = C, 

tan -1 ^ = —C — x, 

tan -1 ^ = D — x, {D = — C) 

— = tan(Z) — x ), 
x 

y = a: tan (D — a;), 


0 


where C is an arbitrary constant and the domain is 

D - x ± (2n + 1) x^(2n+l)| 

for any integer n. Also, since the derivation of the solution is based on the 
assumption that x yf 0 , it is unclear whether or not 0 should be in the domain, 
i.e., does y = x tan(D — x) satisfy the equation when x = 0? We have y — xy' — 
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(a: 2 + y 2 ) =0. If x = 0 and y = a; tan (D — x), then y = 0 and the equation is 
satisfied. Thus, 0 is in the domain. 0 


Proposition 2.10 

Let to = dg. Then for any function P : R. —» R, P(g) is exact. 


Proof. Let Q = f P(t) dy. Then d(Q(g)) = P(g) dg = P(g)u. □ 

To make use of Proposition 2.10, we can group together some terms of u> 
to get an expression you recognize as having an integrating factor and multiply 
the equation by that. The equation will now look like dg + h = 0. If we can 
find an integrating factor for h, it will not necessarily help, since multiplying by 
it might mess up the part that is already exact. But if we can find one of the 
form P(g), then it will work. 

Example 2.11. Solve (x — yx 2 ) dy + y dx = 0. * 

Solution. Expanding, we have 


y dx + x dy —yx 2 dy = 0. 

d(xy) 


Therefore, we can multiply teh equation by any function of xy without disturb¬ 
ing the exactness of its first two terms. Making the last term into a function of 
y alone will make it exact. So we multiply by (xy) 2 , giving us 


■ydx + xdy 
x 2 y 2 


1 dy= 0 
V 


1 

xy 


MM) = c, 


where C is an arbitrary constant. Note that y = 0 on the domain R is also a 
solution. 0 


Given 

M dx + N dy = 0, 

we want to find I such that IM dx + IN dy is exact. If so, then 



/ x AT+/Ar x 



Iy Ad -|~I Ad y 


(*) 
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If we can find any particular solution I(x,y) of the pde 

I X N + IN X = I V M + IM y , (**) 

then we can use it as an integrating factor to find the general solution of (*). 
Unfortunately, (**) is usually even harder to solve than (*), but as we shall see, 
there are times when it is easier. 

Example 2.12. We could look for an I having only ads and no y' s? For exam¬ 
ple, consider I y = 0. Then 

I T - N x 

I X N + IN x = IM y implies — = v ^ -. 

This works if ( M y — N x ) /N happens to be a function of x alone. Then 


Similarly, we can also reverse the role of x and y. If (N x — M y ) /M happens to 
be a function of y alone, then 

ef F^Nv dy 


works. 


* 


2.4 Linear First Order Equations 

A first order linear equation (n = 1) looks like 

y' + P(x)y = Q(x). 

An integrating factor can always be found by the following method. Consider 

dy + P(x)y dx = Q(x) dx , 

(P(x)y — Q(x)) dx + dy =0. 

M(x,y) N(x,y) 

We use the de for the integrating factor I(x,y). The equation IM dx + IN dy 
is exact if 


I X N + IN X = I y M + IM y . 
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In our case, 


I x +0 = Iy ( P{x)y - Q(x )) + IP{x). 


We need only one solution, so we look for one of the form I(x), i.e., with I y = 0. 
Then (*) becomes 


This is separable. So 




= P{x) dx , 


ln(|/|) = j P{x) dx + C, 

|J| = e /P(x)dx ) e x >Q 

l — g f P(x)dX' 

We conclude that ef p ( x ) dx j s an integrating factor for y' + P(x)y = Q(x). 
Example 2.13. Solve y' — (1/x) y = x 3 , where x > 0. 


Solution. Here P(x) = —1/x. Then 

/ = g I P(x)dx = e ~ } I dx _ e ~\n(\x\)dx __ ^ ^ , 

|cc| X ’ 

where x > 0. Our differential equation is 

xdy-y dx _ ^ 


Multiplying by the integrating factor 1/x gives us 

xdy — y dx 2 
--= x dx. 


y - = \ + c, 

x 3 

X 3 

y = y + Cx 

on the domain (0, oo), where C is an arbitrary constant (x > 0 is given). 
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In general, given y' + P(x)y = Q(x), multiply by ef p U)dx to obtain 

e f P(x) dx y / + e f P(x) dx p , x j y = QM e f P(x) dx 

v_._ v _✓ 

d(ye! p <- x '> dx )/dx 

Therefore, 

ye I P(x) dx = f Q( x ) e JP0)dx dx + c ^ 

where C is an arbitrary constant. 

Example 2.14. Solve xy’ + 2 y = Ax 2 . * 

Solution. What should P{x) be? To find it, we put the equation in standard 
form, giving us 

/ 2 

y + -y = Ax. 

X 

Therefore, P{x) = 2/a;. Immediately, we have 

I _ e f(2/x)dx _ gln(a; 2 ) _ ^2. 

Multiplying the equation by x 2 gives us 

x 2 y' + 2 xy = 4a; 3 , 

x 2 y = x 4 + C, 

2 C 

y = x + ~2, 

X z 

where C is an arbitrary constant and x ^ 0. 0 

Example 2.15. Solve e~ v dy + dx + 2x dy = 0. * 


Solution. This equation is linear with a: as a function of y. So what we have is 
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where / = ef 2dy = e 2y . Therefore, 

e 2 v< ^~ + 2xe 2y = —e v , 
ay 

xe 2y = _ e y + C, 

where C is an arbitrary constant. We could solve explicitly for y, but it is messy. 
The domain is not easy to determine. 0 

2.5 Substitutions 

In many cases, equations can be put into one of the standard forms discussed 
above (separable, linear, etc.) by a substitution. 

Example 2.16. Solve y" — 2 y' = 5. * 

Solution. This is a first order linear equation for y'. Let u = y'. Then the 
equation becomes 

u' — 2u = 5. 

The integration factor is then I = e~ $ 2 dx = e -2 *. Thus, 

u'e~ 2x -2ue~ 2x =5e~ 2x , 

ue~ 2x = ~^e~ 2x + C, 

where C is an arbitrary constant. But u = y' , so 

y = -\x + ^e 2 * + C 1 = ~x + C ie 2x + C 2 

on the domain R, where C\ and C 2 are arbitrary constants. 0 

We now look at standard substitutions. 

2.5.1 Bernoulli Equation 

The Bernoulli equation is given by 

^ + P(x)y = Q(x)y n . 

dz 
dx 


Let z = y 1 n . Then 


n N -n d V 

il ~ n)y Tz 
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giving us 


y- n i^ + P(x)y 1 ~ n 
dx 


1 dz 


P{x)z 


1 — n dx 

dz , . . 

— + (1 — n) P(x)z 
dx 


Q(x), 

Q(x), 

(1 -n)Q(x), 


which is linear in z. 


Example 2.17. Solve y' + xy = xy 3 . 


* 


Solution. Here, we have n = 3. Let z = y 2 . If y ^ 0, then 

dz „ ody 

T, = ~ 2y T,' 

Therefore, our equation becomes 

y 3 -' , 3 

-“ 2 “ +a;y = xy , 

z' -2 

-^- + ^ 2 / = x, 

z! — 2 xy = —2x. 

We can readily see that I = e~ -T 2xdx = e~ x . Thus, 

e“' x V - 2xe~ x2 = -2xe ~ x2 , 

e~ x2 z = e~ x2 + C, 
z = l + Ce x2 , 


where C is an arbitrary constant. But z = y 2 . So 

1 


y = ± 


Vl + Ce x ' 2 ' 


The domain is 


C>- 1, 

> 1 /-ln(-C'), C < -1. 


An additional solution is y = 0 on R. 


0 



2.5. SUBSTITUTIONS 


19 


2.5.2 Homogeneous Equations 

Definition (Homogeneous function of degree n) 

A function F(x,y) is called homogeneous of degree n if F(Xx,Xy) = X n F(x,y). 
For a polynomial, homogeneous says that all of the terms have the same degree. 

Example 2.18. The following are homogeneous functions of various degrees: 


3a : 6 + 5a A y 2 

homogeneous of degree 6 , 

3a : 6 + 5a - 3 y 2 

not homogeneous, 

x\J x 2 + y 2 

homogeneous of degree 2 , 

sin © 

homogeneous of degree 0 , 

1 

x + y 

homogeneous of degree — 1 


If F is homogeneous of degree n and G is homogeneous of degree k, then 
F/G is homogeneous of degree n — k. 



Proof. We have F(Xx,Xy) = F(x,y ) for all A. Let A = 1/x. Then F(x,y) = 
F{l,y/x). □ 

Example 2.20. Here are some examples of writing a homogeneous function of 
degree 0 as a function oi y/x. 


y 3 + x 2 y ( y/x) 3 + [y/x] 

- = - . * 

x 2 y + x 3 (y/ x ) + 1 

Consider M(x, y) dx + N(x, y) dy = 0. Suppose M and N are both homoge¬ 
neous and of the same degree. Then 

dy M 

d® = _ iV’ 
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This suggests that v = y/x (or equivalently, y = vx) might help. In fact, write 

M(x,y) = ry\ 

N(x,y) \xJ ' 

Then 


Therefore, 

x— = R(v) — v, 
ax 

dv dx 

R(v) — v x ’ 

which is separable. We conclude that if M and N are homogeneous of the same 
degree, setting y = vx will give a separable equation in v and x. 

Example 2.21. Solve xy 2 dy = ( x 3 + y 3 ) dx. * 

Solution. Let y = vx. Then dy = v dx + x dv, and our equation becomes 

xv 2 x 2 (v dx + x dv) = (x 3 + v 3 x 2 ) dx, 
x 3 v 3 dx + x 4 v 2 dv = x 3 dx + v 3 x 3 dx. 

Therefore, x = 0 or v 2 dv = dx/x. So we have 
v 3 

— = ln(|cc|) + C = ln(|a;|) + ln(|j4|) = ln(|Ax|) = ln(Ar). 

c 

where the sign of A is the opposite of the sign of x. Therefore, the general 
solution is y — x(3\n(Ax)) 1 3 , where A is a nonzero constant. Every A > 0 
yields a solution on the domain (0, oo); every A < 0 yields a solution on (— oo, 0). 
In addition, there is the solution y = 0 on the domain R. 0 

2.5.3 Substitution to Reduce Second Order Equations to 
First Order 

A second order de has the form 



F(y”,y',y,x) = 0. 
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If it is independent of y , namely, F(y" ,y' ,x) = 0, then it is really just a first 
order equation for y' as we saw in earlier examples. 


Consider now the case where it is independent of x, namely, F{y", y' 1 y) = 0. 
Substitute v = dy/dx for x, i.e., eliminate x between the equations 


F 


d 2 y dy \ 
dx 2 ’ dx ’ / 


= 0 


and v = dy/dx. Then 


d 2 y dv dv dy dv 
dx 2 dx dy dx dy 


Therefore, 


F 


d 2 y dy \ 
dx 2 ’ dx ’ / 


= 0 F 


dv 

dy 


v,v,y 


= 0 . 


This is a first order equation in v and y. 


Example 2.22. Solve y" = 4(y') 3 ^ 2 y. 


* 


Solution. Let v = dy/dx. Then 


d 2 y dv 
dx 2 dy 


dv 

dy V 

dv 


4 v 3/2 y, 
4 y dy, 


v > 0, 


2y/v — 2 + Cl, 


Vv = y 2 + C 2 , 


and our equation becomes 
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where C\ is an arbitrary constant and C 2 = C\/2. But v 
dy 


dx 
dx = 


— (y 2 + C2) 
dy 


G y 2 + ^2) 2 

dy 



2( —C 2 ) 3/2 V 2 +C 2 

Next consider second order linear equations. That is, 


= dy/dx, so we have 


C 2 >0, 

C 2 = 0, 0 

c 2 < 0 . 


P(x)y" + Q{x)y' + R(x)y = 0. 

We can eliminate y by letting y = e v . Then y' = e v v' and y" = e v ( v') 2 + e v v". 
The equation then becomes 

P{x) (e v (v 1 ) 2 + e v v"^j + Q{x)e v v' + R(x)e v = 0, 

which is a first order equation in v'. 

Example 2.23. Solve x 2 y" + {x — x 2 ) 1 / — e 2x y = 0. * 


Solution. Let y = e v . Then the equation becomes 

x 2 e v (t/) 2 + x 2 e v v" + (a; — x 2 ) e v v' — e 2x e v = 0. 

Write z = v'. Then 

x 2 z’ + x 2 z 2 + (1 -x)xz — e 2x . 

Now we are on our own—there is no standard technique for this case. Suppose 
we try u = xy. Then z = u/x and 

, u 1 , 
z — H—it . 

X z X 


Then it follows that 


xv! F u 2 — xu == e 2 *. 


This is a bit simpler, but it is still nonstandard. We can see that letting u = se x 
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will give us some cancellation. Thus, v! = s' e x + se x and our equation becomes 


u/oo -tco c- . 


xs' + s 2 e x = e x , 



xs' = e x (l — s 2 ) , 


1 — s 2 x ’ 



Working our way back through the subsitutions we find that s = zxe x so our 
solution becomes 


Using algebra, we could solve this equation for z in terms of x and then integrate 
the result to get v which then determines y = e v as a function of x. The 
algebraic solution for 2 is messy and we will not be able to find a closed form 
expression for the antidervative v, so we will abandon the calculation at this 
point. In practical applications one would generally use power series techniques 
on equations of this form and calculate as many terms of the Taylor series of 
the solution as are needed to give the desired accuracy. 0 


1 + zxe x 
1 — zxe~ x 


dx. 


Next consider equations of the form 

{a\x + biy + ci) dx + (a 2 x + b 2 y + c 2 ) dy = 0. 

If Ci = c 2 = 0, the equation is homogeneous of degree 1. If not, try letting 
x = x — h and y = y — k. We try to choose h and k to make the equation 
homogeneous. Since h and k are constants, we have dx = dx and dy = dy. 
Then our equation becomes 

(dix + a\h + biy + bik + Ci) dx + ( a 2 x + a 2 h + b 2 y + b 2 k + c 2 ) dy = 0. 

We want a-\ h + bik = — ci and a 2 h + b 2 k = —c 2 . We can always solve for h and 
k, unless 

I h 



24 CHAPTER 2. FIRST ORDER ORDINARY DIFFERENTIAL EQUATIONS 


So suppose 

M h = () 

0 2 t>2 

Then ( 02 , 62 ) = Let z = ciix + b\y. Then dz = aidx + bidy. If 

b\ ^ 0 , we have 


dy = 


dz — a\ dx 


bi 


, , , , , dz — oi dx 

{z + ci) dx + (mz + c 2 )- 1 -= 0, 


Cl 


Oi 

bi 


dx - 


bi 

mz + c 2 
bi 


dx = 0 , 


, , mz + c 2 , 

b\ dx =- j- — dz. 

Z + C\ + 0-1/0 1 


This is a separable equation. 

If 61 = 0 but & 2 ^ 0, we use z = a 2 a; + 6 2 y instead. Finally, if both 61 = 0 
and 6 2 = 0 , then the original equation is separable. 



Chapter 3 

Applications and Examples 
of First Order Ordinary 
Differential Equations 

3.1 Orthogonal Trajectories 

An equation of the form f(x, y,C ) = 0 determines a family of curves, one for 
every value of the constant C. Figure 3.1 shows curves with several values of 
C. Differentiating f(x,y,C ) = 0 with respect to x gives a second equation 



Figure 3.1: Graphs of x 2 + y 2 — C = 0 with various values of C. 
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g(x , y , C, dy/dx) = 0, which is explicitly given by 

df , df dy 

9 = -rr (x, y,C) + — (x, y,C)—. 
ox ay dx 


Example 3.1. We have 


x 2 + y 3 + Ca: 4 = 0 implies 2a; + 3 y 2< ^~ + ICx 2 = 0. 

dx 

We can eliminate C between the equations / = 0 and g = 0, that is, 

/ = 0 => C = 


Therefore, 


9 = 0 => 2* - 3 #^ - = o. 

aa; a: 


This yields a first order DE, where the solution includes the initial family of 
curves. * 


So just as a first order de usually determines a one-parameter family of 
curves (its solutions), a one-parameter family of curves determines a de. 

A coordinate system (Cartesian coordinates, polar coordinates, etc.) consists 
of two families of curves which always intersect at right angles. Two families of 
curves which always intersect at right angles are called orthogonal trajectories 
of each other. Given a one-parameter family of curves, we wish to find another 
family of curves which always intersects it at right angles. 

Example 3.2. Find orthogonal trajectories of y = C'sin(a’). * 


Solution. Figure 3.2 shows the plot of y = Csin(a;) with several values of C. 
We have C = y/ sin(a;), so it follows that 


dy 

dx 



V/ sin(x) 


cos (a;) = y 


cos (a;) 
sin(a;) 


y cot (a:). 


Two curves meet at right angles if the product of their slopes is —1, i.e., m new = 
— l/m 0 id- So orthogonal trajectories satisfy the equation 

dy 1 tan (a;) 

dx y cot (a:) y 
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Figure 3.2: A plot of the family y = C sin(a;) (in black) and its orthogonal 
trajectories (in gray). 



3.2 Exponential Growth and Decay 

There are many situations where the rate of change of some quantity x is pro¬ 
portional to the amount of that quantity, i.e., dx/dt = kx for some constant k. 
The general solution is x = Ae kt . 

1. Radium gradually changes into uranium. If x{t) represents the amount of 
radium present at time t, then dx/dt = kx. In this case, k < 0. 

2. Bank interest. The amount of interest you receive on your bank account is 
proportional to your balance. In this case, k > 0. Actually, you do not do 
quite this well at the bank because they compound only daily rather than 
continuously, e.g., if we measure this time in years, our model predicts 
that x = x$e kt , where xq is your initial investment and k is the interest 
rate. Actually, you get 


x = Xo 1 H —t 
V n 



28 CHAPTER 3. APPLICATIONS AND EXAMPLES OF FIRST ORDER ODE ’S 


where n is the number of interest periods throughout the year. Typically, 
n = 365 (daily interest), but the difference is small when n = 365. Note 
that lim n — >00 (1 + kt/n) n = e kt . 

3. Population growth of rabbits. The number of rabbits born at any time 
is roughly proportional to the number of rabbits present. If x(t) is the 
number of rabbits at time t, then dx/dtt = kx with k > 0. Obviously, this 
model is not accurate as it ignores deaths. 


Example 3.3. The half-life of radium is 1600 years, i.e., it takes 1600 years for 
half of any quantity to decay. If a sample initially contains 50 g, how long will 
it be until it contains 45 g? * 


Solution. Let x(t) be the amount of radium present at time t in years. Then 
we know that dx/dt = kx, so x = Xoe kt . With x(0) = 50, we quickly have 
x = 50e kt . Solving for t gives t = ln(a;/50) /k. With x(1600) = 25, we have 
25 = 50e 16OOfe . Therefore, 


1600A: = In 


-M2), 


giving us k = — ln(2) /1600. When x = 45, we have 


_ ln(®/50) _ ln(45/50) _ ln(8/10) 

k — ln(2) /1600 ln(2) 

« 1600 • « 1600 x 0.152 « 243.2. 

0.693 


1600 • 


ln(10/8) 


Therefore, it will be approximately 243.2 years until the sample contains 45 g 
of radium. (> 


3.3 Population Growth 

Earlier, we discussed population growth where we considered only births. We 
now consider deaths also. Take, as our model, the following. 

Let N(t) be the number of people at time t. Assume that the land is intrinsi¬ 
cally capable of supporting L people and that the rate of increase is proportional 
to both N and L — N. Then 


dJV 

dt 


kN ( L-N ), 
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and the solution is 

N = _—_ 

1 + (L/N 0 — 1) e~ kLt ’ 

where k is the proportionality constant. 


3.4 Predator-Prey Models 

Example 3.4 (Predator-Prey). Consider a land populated by foxes and rab¬ 
bits, where the foxes prey upon the rabbits. Let x(t) and y(t) be the number 
of rabbits and foxes, respectively, at time t. In the absence of predators, at any 
time, the number of rabbits would grow at a rate proportional to the number 
of rabbits at that time. However, the presence of predators also causes the 
number of rabbits to decline in proportion to the number of encounters between 
a fox and a rabbit, which is proportional to the product x{t)y(t). Therefore, 
dx/dt = ax — bxy for some positive constants a and b. For the foxes, the 
presence of other foxes represents competition for food, so the number declines 
proportionally to the number of foxes but grows proportionally to the number 
of encounters. Therefore dy/dt = —cx + dxy for some positive constants c and 
d. The system 

dx 

dt 

d y , a 

dt 

is our mathematical model. 

If we want to find the function y(x), which gives the way that the number 
of foxes and rabbits are related, we begin by dividing to get the differential 
equation 

dy —cy + dxy 
dx ax — bxy 

with a,b,c,d,x{t),y(t) positive. 

This equation is separable and can be rewritten as 

(a — by) dy (—c + dx) dx 

y x 


Integrating gives 


aln(y) — by = — cln(a;) + dx + C, 
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or equivalently 

y a e~ by = kx~ c e dx (3.1) 

for some positive constant k = e c . 

The graph of a typical solution is shown in Figure 3.3. 


20f- d 



Figure 3.3: A typical solution of the Predator-Prey model with a = 9.4, b = 1.58, 
c = 6.84, d = 1.3, and k = 7.54. 

Beginning at a point such as a, where there are few rabbits and few foxes, the 
fox population does not initially increase much due to the lack of food, but with 
so few predators, the number of rabbits multiplies rapidly. After a while, the 
point b is reached, at which time the large food supply causes the rapid increase 
in the number of foxes, which in turn curtails the growth of the rabbits. By 
the time point c is reached, the large number of predators causes the number of 
rabbits to decrease. Eventually, point d is reached, where the number of rabbits 
has declined to the point where the lack of food causes the fox population to 
decrease, eventually returning the situation to point a. * 


3.5 Newton’s Law of Cooling 


Let T and T s be the temperature of an object and its surroundings, respectively. 
Let Tq and T So be initial temperatures. Then Newton’s Law of Cooling states 



3.6. WATER TANKS 


31 


that 

d ^ = k{T s ^T), k> 0. 

As T changes, the object gives or takes heat from its surroundings. We now 
have two cases. 

Case 1: T s is constant. This occurs either because the heat given off is 
transported elsewhere or because the surroundings are so large that the contri¬ 
bution is negligible. In such a case, we have 

^ + kT = kT s , 
at 

which is linear, and the solution is 


T = T 0 e~ kt + T S (1- e~ kt ) . 

Case 2: The system is closed. All heat lost by the object is gained by its 
surroundings. We need to find T s as a function of T. We have 


change in temperature = 


heat gained 


weight x specific heat capacity 


Therefore, 


T - To T„- T,, 


wc 


dT , , , 
^ + (:|1 + 


WC 

w s c s 


Ts = T s + -(To - T) 

w s c s 

T = k [ T So + —T 0 
w s c s 


This is linear with different constants than the previous case. The solution is 


T = T 0 + 


rp | WC rp 
lg 0 + 

1 + 


(l - . 


3.6 Water Tanks 

Example 3.5. A tank contains a salt water solution consisting initially of 20 kg 
of salt dissolved into 10 i of water. Fresh water is being poured into the tank 
at a rate of 3 (/min and the solution (kept uniform by stirring) is flowing out at 
2 (/min. Figure 3.4 shows this setup. Find the amount of salt in the tank after 
5 minutes. * 



32 CHAPTER 3. APPLICATIONS AND EXAMPLES OF FIRST ORDER ODE ’S 


3 litre/ m in 



2 litre/min 


Figure 3.4: Fresh water is being poured into the tank as the well-mixed solution 
is flowing out. 


Solution. Let Q(t) be the amount (in kilograms) of salt in the tank at time t 
(in minutes). The volume of water at time t is 

10 + 3f - 2£ = 10 + t. 

The concentration at time t is given by 

amount of salt Q 
volume 10 T t 

kg per litre. Then 

dQ = - (rate at which salt is leaving) =-. 2 = - 2 9_ 

dt y 10 + 1 10 + 1 

Thus, the solution to the problem is the solution of 

dQ _ 2 Q 

dt 10 + 1 


evaluated at t = 5. We see that it is simply a separable equation. 
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To solve it, we have 


dQ 

~Q 

dQ 

~Q 


= -2 
= -2 


dt 


10 + t' 
f dt 


10 + t’ 

In(IQI) = —2In (110 + t\) , 
ln(|Q|) = ln(|10 + tr 2 ) +C, 


where C is a constant. Thus, 


ln(|Q|) = ln(|10 + *r 2 ) +C, 
i A 110 + t\ 


= In 


\Q\ — A 110 + 1\ 


where A = e c . But Q > 0 (we cannot have a negative amount of salt) and t > 0 
(we do not visit the past), so we remove absolute value signs, giving us 


Q — A (10 + t) 


-2 


Initially, i.e., at t = 0, we know that the tank contains 20 kg of salt. Thus, 
the initial condition is Q(0) = 20, and we have 


0 ( 20 ) = 0 


A 


(10 + 0) 2 

Our equation therefore becomes 


= 20 


A 

100 


= 20 : 


A = 2000. 


, 2000 

Q(t) = -o- 

(10 +t) 2 

Figure 3.5 shows a plot of the solution. Evaluating at t = 5 gives 

2000 80 80 o 
«< 5 > = -W = 225 = ¥ “ 8m 


Therefore, after 5 minutes, the tank will contain approximately 8.89 kg of salt.O 


Additional conditions desired of the solution (Q(0) = 20) in the above exam¬ 
ple) are called boundary conditions and a differential equations together with 
boundary conditions is called a boundary-value problem (BVP). 
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O 



Figure 3.5: The plot of the amount of salt Q(t) in the tank at time t shows that 
salt leaves slower as time moves on. 

A = jjxITty 1 S eneral solution to the DE ^ Q = is the 

solution to the boundary value problem = — yyry ■; <3(0) = 200. Boundary- 
value problems like this one where the boundary conditions are initial values of 
various quantities are also called initial-value problems (IVP). 


3.7 Motion of Objects Falling Under Gravity 
with Air Resistance 


Let x(i) be the height at time t, measured positively on the downward direction. 
If we consider only gravity, then 

cPx 

is a constant, denoted g , the acceleration due to gravity. Note that F = ma = 
mg. Air resistance encountered depends on the shape of the object and other 
things, but under most circumstances, the most significant effect is a force op¬ 
posing the motion which is proportional to a power of the velocity. So 



mg — kv n 


d 2 x k 

dt 2 ^ m 


and 


dx 

dt 


n 
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which is a second order DE, but there is no x term. So it is first order in x'. 
Therefore, 

dv k „ 

— — g - v ■ 

dt m 

This is not easy to solve, so we will make the simplifying approximation that 
n = 1 (if v is small, there is not much difference between v and v n ). Therefore, 
we have 

dv k 

-77 = 9 — v, 
dt to 

dv k 
M + m V = 9 - 


The integrating factor is 

Therefore, 


/ = g/ 4 dt _ gfct/m_ 


— -U e kt / m = ge kt ' m , 


dt 


0 kt l m v = 3J^ e kt/m _|_ q 

v=^ + Ce~ kt/m , 
k 


where C is an arbitrary constant. Note that 


So we have 


Note that 


too mb 

u(0) = Vq => V 0 = -jd + c => C = v 0 - Y' 


rv V k / 

dx/dt 




'#0 
x—a^o 


Thus, we finally have 





36 CHAPTER 3. APPLICATIONS AND EXAMPLES OF FIRST ORDER ODE ’S 


3.8 Escape Velocity 


Let x{t) be the height of an object at time t measured positively upward (from 
the centre of the earth). Newton’s Law of Gravitation states that 

kmM 

ma 


where m is the mass of the object, M is the mass of the Earth, and k > 0. Note 
that 


kM 


x = —- 


We define the constant g known as the ’’acceleration due to gravity” by x" = —g 
when x = R, where R = radius of the earth. So k = gR 2 /M. Therefore 
x" = — gR 2 /x 2 . Since t does not appear, letting v = dx/dt so that 


d 2 x dv dx dv 
dt 2 dx dt dx 


will reduce it to first order. Thus, 


dv 

V di 


v dv 


I 


v dv 


v 


2 


2 


gR 2 


gR 2 , 

- T dx > 

X A 

!~ 9 -§r dx ’ 


gR 2 


■c, 


for some arbitrary constant C. Note that v decreases as x increases, and if v is 
not sufficiently large, eventually v = 0 at some height x max . So C = —gR 2 /x max 


and 


u 2 = 2 R 2 g (i 



Suppose we leave the surface of the Earth starting with velocity V. How far 
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will we get? (v = V when x = R). We have 


1/2 = ^ (s - 

V 2 _ 1 1 

2 R 2 g R x max ’ 

1 _ 1 V 2 

Imax R 2R 2 g 

2 R 2 g 

Xmax “ 2Rg _ 1/2 ' 
That is, if V 2 < 2Rg , we will get as far as 



2 Rg - V 2 
2 R 2 g 


2R 2 g 

2 Rg - V 2 


and then fall back. To escape, we need V > yj2Rg. Thus, the escape velocity 
is x/2%«6.9 mi /s, or roughly 25000 mph. 


3.9 Planetary Motion 

Newton’s law of gravitation states that 

n _f / = 

ma 

Suppose we let a r = —k/r 2 and ao = 0. Then 

a r = a x cos (0) + a y sin(0), ag = —a x sin($) + a y cos (9). 

Let x = rcos(0) and y = rsin(0). Then 
x' = r' cos(9) — rsm(0)6', 

a x = x" = r" cos(0) — r' sin(0)O' — r'sin(0)0' — rcos(0) (O') 2 — rsm(0)0", 
y' = r' sm(6) + r cos (0)6', 

a y = y" = r" sin(0) + r cos(0)0' + r' cos (6)0' — rsin(0) (O') 2 + rcos(0)0" 
= r" sin(0) + 2 r'O' cos(0) — (O') 2 r sin(0) + 0"rcos(0). 
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Now a r becomes 

a r = r" cos 2 {9) — 2r'9' sin($) cos (9) — (9 1 ) 2 rcos 2 (9) — 9" sin(0) cos (9) 

+ r" sin 2 (0) + 2r'9' sin(0) cos(0) — (9') 2 r sin 2 (0) + 9"r sin($) cos (9) 

= r"-{9') 2 r 

and ag becomes 

clq = — r" sin(0) cos(0) + 2r'9' sin 2 (0) + (9') 2 r sin(0) cos(0) + 9”r sin 2 (9) 

+ r" sin($) cos (9) + 2r'9' cos 2 (9) — (9 1 ) 2 rsin(9 ) cos(0) + 9"r cos 2 (9) 

= 2r'9' + 9"r. 

Note that 

r" - (9'f r = (*) 

2r'6>' + 0"r = 0. (**) 

Equation (**) implies that* 

2 rr'9' + 9” r 2 = 0 => r 2 6>' = h. 

" -V-' 

d(r 2 6') 

We want the path of the planet, so want an equation involving r and 9. There¬ 
fore, we eliminate t between Equation (*) and r 2 9' = h. Thus, 

, dr , dr h 
d9 d9 r 2 ’ 

// d 2 r , h dr h , d 2 r h h dr h dr h 

d9 2 r 2 d9 r 2 d9 2 r 2 r 2 d9 r 3 d9 r 2 

h 2 ( 2 f dr\ 2 1 d 2 r\ 

r 2 (r 3 \ d0) r 2 d9 2 J 


‘Note that 

re r 't())2 

dr dd = / —— dO, 

Je o 2 

so dA/d6 = r(0) 2 / 2. So in our case, A' = h/2. Therefore, A = ht/ 2, which is Kepler’s Second 
Law (area swept out is proportional to time). 
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Let u = 1 jr. Then 


du 

1 dr 

dd = 

r 2 d0 ’ 

d 2 u 

2 

( dr \ 

dd 2 = 

r 3 ' 

V dd 


2 1 d 2 r r 2 r" 

r 2 dd 2 h 2 


h 2 u 2 


Therefore, Equation (*) implies that 


, 9 9 d 2 u ( h 


Therefore, 


r= “^2’ 


2 2 a a 3 j2 7 2 /n 

—h u — 7 T — u h = —to , wf 0, 
dd z 

d 2 u k 

de 2 +u= h 2 ' 


1/r 


= Bcos(d - 5) + — = Cisin(0) + C 2 cos(0) + —, 


where 


Therefore, 


k/h 2 + B cos (9 — 6) k/h 2 + Ci sin(0) + C 2 € 08 ( 6 *) ’ 


T r+Cix+C 2 y 


—jr + C'irsin(0) + C 2 r cos( 6 >) = 1, 


-rr.r = 1- C\X - C 2 X, 
h z 

^4 (x 2 + y 2 ) = (1 - C\x - C 2 yf , 


which is the equation of an ellipse. 


3.10 Particle Moving on a Curve 

Let x(t) and y(t) denote the x and y coordinates of a point at time t, respectively. 
Pick a reference point on the curve and let s(t) be the arc length of the piece 
of the curve between the reference point and the particle. Figure 3.6 illustrates 
this idea. Then 
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Reference point 



Particle 


Figure 3.6: A particle moving on a curve. 


v = 


ds 
dt ’ 


INI =a = 


d 2 s 

dt 2 


The vector v is in the tangent direction. The goal is to find components a in 
the tangential and normal directions. Let 6 be the angle between the tangent 
line and the x axis. Then 


cos(0) 


dx 
ds 1 


sin(0) 


dy 

ds 


In the standard basis, we have a = ( a x , a y ), where 


d 2 x d 2 y 

ttx= d ay= W' 

To get components in T,n basis, apply the matrix representing the change of 
basis from T, n to the standard basis, i.e., rotation by — 6 , i.e., 


cos(0) 

sin(0) 


a x 


a x cos(d) + a y sin(0) 

— sin($) 

cos (9) 


. a y . 


— a x sin(0) + a y cos(d) 


i.e., 


dx dy 

ax = a x cos(6>) + a y sin(6>) = a x — — a y -j- 

lit) Cio 

dx dy\ dt a x v x + a v v v 

= I a T — + 0^— — =-— 

dt dt J ds v 


and 


a n = — a x sin(0) + a y cos (9) = 
Also, we have v = ^ jv 2 + v 2 , so 


d 2 s dv 
dt 2 dt 


2v ^ + 2v 

dt dt 


^ X Oj X T Uytty 
V 


= ax- 



3.10. PARTICLE MOVING ON A CURVE 


41 


But this was clear to start with because it is the component of a in the tangential 
direction that affects ds/dt. 

We now have 


dy dy/dt v y 


y =*»„. = 


dx dx/dt 


V = 


dVnj 


U V dx 


dv v dt 

Vx ~dt dx ~~ U 


dv x dt 
V dt dx 


V x Cty 'VyCLx 


a n V 

7 ,3 ’ 


where a n = y"v^./v and 


dx dx ds dx 

dt ds dt ds ’ 


so 



v 


y"v 2 

( ds/dx )'" 



Let 


R = 


(i + wf) 


3/2 


y 


H 


(3.2) 


so that a n = v 2 /R. The quantity R is called the radius of curvature. It is the 
radius of the circle which mostly closely fits the curve at that point. This is 
shown in Figure 3.7. If the curve is a circle, then I? is a constant equal to the 



Figure 3.7: The radius of curvature is the circle whose edge best matches a 
given curve at a particular point. 


radius. 

Conversely, suppose that R is a constant. Then 

Ry" = (l + G/) 2 ) 372 . 
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Let z = y'. Then 


and 


so 


Therefore, 


Rz' = (1 + z 2 ) 

, Rdz 

dx = 


3/2 


(1 + Z 2 ) 3/2 ’ 


R 


X = 


(l + Z 2 ) 3/2 ~~ vTTz 

R 


1 R Z A 

dz = , + A , 


x — A = 


~ +1 = 


vW^F+i’ 

R 2 


{x - Ay 
2 i? 2 


0 - A)" 


- 1 = 


R 2 -{x- Ay 


{x-A) 


2 ’ 


J2 _ 


^ = ± 

dy / dx 


R 2 -{x- Ay 
x — A 


\J R 2 — (x — A) 2 


y=± 


x — A 


: dx 


aJr 2 - (x- A)‘ 

= ±\JR 2 - {x - A) 2 + B, 


(: y-B) 2 = R 2 -(x-A ) 2 


(x — A) 2 + (y — -B) 2 = -R 2 . 


Suppose now that the only external force F acting on the particle is gravity, 
i.e., F = (0, —mg). Then in terms of the T, n basis, the components of F are 


cos(0) 

sin(0) 


0 


—mg sin(0) 


i- 

co 

1 

i_ 

— sin(0) 

cos(0) 


—mg 


—mg cos(0) 


L \ 
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Equating the tangential components gives us 


,d 2 s dy 

= -*<>d.;• 

ds 


dt 

d 2 s 


dv ds dv 


dt 2 dt dt ds V ’ 

dv dy 

ds V = ~ 9 Ts’ 
v dv = —g dy , 

,,2 

= -g(y - no) = g(yo - y), 
= v = Ev'Zgiyo - y)- 


V 

2 

ds 

dt 


To proceed, we must know y(s), which depends on the curve. Therefore, 

ds 


dt = E 

t = ± 


y/2g{y 0 -y{s)) 7 
I ds 

J V 2 g(yo - y(s)) 


If the ma n ever becomes greater than the normal component of F, the particle 
will fly off the curve. This will happen when 


pC- 


y"vl 


y" v l = 


dx 

-ptg-r 

ds 

-g , 


= -g 


dx dt 
dt ds 


= -g- 


dx dx ds dx 
dt ds dt ds 


Therefore, 


( 

V 


-0 = y 


„ / dx\ 

\ds J 


2 


i + (yf 


( ds/dx ) 2 
y"20(y o - y) 

1 + 0 y’f 


\ 


2 y"(y - yo) 


) 


i + {y'f- 


Example 3.6. A particle is placed at the point (1,1) on the curve y = x 3 and 
released. It slides down the curve under the influence of gravity. Determine 
whether or not it will ever fly off the curve, and if so, where. * 
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Solution. First note that 

y = x 3 , y' = 3x 2 , y" = 6x, y 0 = 1. 

Therefore, 

2y"{y-y 0 ) = l-{y')\ 

I2x {x 3 — l) = 1 + 9a; 4 , 

12a; 4 - 12a; = 1 + 9a; 4 , 

3a; 4 - 12a; - 1 = 0. 0 

Solving for the relevant value of x gives us x « —0.083, which corresponds to y ~ 
—0.00057. Therefore, the particle will fly off the curve at (—0.083,-0.00057). 
Figure 3.8 shows the graph. 



Figure 3.8: A particle released from (1,1), under the influence of gravity, will 
fly off the curve at approximately (—0.083,-0.00057). 



Chapter 4 

Linear Differential 
Equations 


Although we have dealt with a lot of manageable cases, first order equations 
are difficult in general. But second order equations are much worse. The most 
manageable case is linear equations. We begin with the general theory of linear 
differential equations. Specific techniques for solving these equations will be 
given later. 


Definition (nth order linear differential equation) 

An nth order linear differential equation is an equation of the form* 


cTy 

dx n 


Pi Or) 


d n ~ x y 

dx n ~ x 


P- 2 {x) 


d n ~ 2 y 
dx n ~ 2 


H-1- P n (x)y = Q{x). 


An nth order linear equation can be written as a linear system (see Chapter 
9) as follows. Let 


2/i 0*0 = 2/0*0, y 2 {x) 


dy 
dx 1 


2 / 30*0 


d 2 y 

dx 2 ’ 


Vn{x) 


d n ~ 1 y 

dx ™ -1 


Then 


dyi _ dy 2 
dx ^ 2 ’ dx 


2 / 3 , 


dy n -i 
dx 


= Vn 


*If the coefficient of d n y/dx n is not 1, we can divide the equation through this coefficient 
to write it in normal form. A linear equation is in normal form when the coefficient of y( n ^ is 
1. 
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d n ^- 7 / 

Pl ( X ) rfx n -i - P n (x)y + Q(x) 

Pi{x)y n - Pn{x)yi + Q{x). 


= A(s)Y + B(a:), 


0 10 

0 0 1 

A(a:) = ; ; i 

0 0 0 
- P n {x ) -P n _i(a;) -P n - 2 (x) 

and 

0 
0 

B(*) = j 

0 

Q(x) 


Theorem 4.1 


If Pi (a:),..., P n {x ), Q(x) are continuous throughout some interval / and Xq 
is an interior point of I, then for any numbers Wo, ■ ■ ■, W n - 1 , there exists 

a unique solution* throughout / of 


d n y „ . , d n ~ ly 
dx" +Pl{x) dx"-i + ' 

■ + P n {x)y = Q(x) 

satisfying 


y{x 0 )=w 0 , y'{x 0 )=w 1 , 

y (n_1) (x 0 ) = 


Proof. The proof is given in Chapter 10. □ 



and we have 

dy n _ d n y 
dx dx n 


Therefore, 


where 
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4.1 Homogeneous Linear Equations 

To begin, consider the case where Q(x) = 0 called the homogeneous case , where 
y (n) + Pi(x)y( n -V + P 2 (x)y (n - 2) + • • • + P n (x)y = 0. (4.1) 

Proposition 4.2 

1. If r(x) is a solution of Equation (4.1), then so is ar(x) for all r € K. 

2. If r(x) and s(x) are solutions of Equation (4.1), then so is r(x) + s(x). 

Proof. 

1. Substituting y = ar into the LHS gives 

ar («) _|_ p 1 (a;)ar^™ _1) + • • • + P n (x)ar = a + • • • + P n (x)r ^ . 

But since r is a solution, we have 

a (r^ + ■ ■ ■ + P n (x)r'j = a ■ 0. 


Therefore, ar is a solution. 

2. Substituting y = r + s in the LHS gives 
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Proof. Let V be the set of solutions to Equation (4.1) and let t/i, y 2 , ■ ■ ■, y n € V. 
Further, let xq £ R. Set 


W(y 1 ,y 2 ,...,y n ) ( x ) = 


the Wronskian of y \, y 2 , • ■ ■, y n 


yi(x) 

2/2 (*) 

y n (x ) 

y'i(x) 

y'l (x) 

y'Jx) 

2/i n_1) (a;) 

y 2 n ~ 1} (x) ■■ 

■ yL n ~ 1} (x) 

Then 




two equal rows two equal rows 




( 

Vi{x) 

y n (x) 

\ 

n 

E 

k =1 

Pk(x) 

y[ n ~ 2 ) (x) ■■ 

• yiT~ 2 \x) 



V 

y[ n \x) ■■ 

yn\x) 

! 


Therefore, W = Ae S p A x ) dx . Th} s j s Abel’s formula. There are two cases: 


A = 0 W(x) = 0, 
A^0=> W(x) ± x 


for all x. 


□ 
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Theorem 4.4 

Let V be the set of solutions to Equation (4.1) and suppose that 
y-\,y 2 ,..., ij n £ V. Then y\, 3 / 2 , • • •, y n are linearly independent if and only 
if IT yt 0. 


Proof. Let V be the set of solutions to Equation (4.1) and suppose that yi, y 2 ,..., y n £ 
V. Suppose that yi, y 2 , • • •, y n are linearly dependent. Then there exists con¬ 
stants ci, C 2 ,..., c n such that 


cij/i(x) + c 2 y 2 (x) H-1- c n y n (x) = 0, 

c iVi(x) + c 2 y' 2 {x) H-h c n y' n {x) = 0, 


ciy[ n 1 \x) + c 2 y i 2 n 1} (x) H-f c n y^ 1) (x) = 0. 

Since there exists a nonzero solution for (ci, c 2 ,..., c n ) of the equation, we have 


M 


Cl 

C 2 


= 0 , 


so it follows that \M\ = 0 = W. 

Now suppose that W = 0. Select an xo £ K. Since W(x) = 0, we have 
W{xq) = 0. Thus, there exists constants Ci, c 2 , ■ ■ ■, c n not all zero such that 


Cl 

C2 


where 


2/1 (x 0 ) ••• 2/n(xo) 

2 /i" _1) (x 0 ) ••• y { n~ l \x 0 ) 


M = 
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that is, 


ciyi(x 0 ) + c 2 y 2 {x 0 ) H-1- c n y n (x 0 ) = 0, 

c\y'\(xo) + c 2 y 2 (x 0 ) H-h c n y' n (x 0 ) = 0, 


ciy[ n 1] (a;o) + c 2 y 2 n ^(zo) H-f c n y ^(xo) = 0. 

Let y(x) = ciyi(x) + c 2 y 2 {x) H - 1- c n y n (x). Since y\,y 2 , ■■■,y n are solutions 

to Equation (4.1), so is /, and / satisfies 

f(x o )=0, /'(^o) = 0, f"(xo) = 0, ..., / ( ” _1) (a:o) = 0. 

But y = 0 also satisfies these conditions, and by the uniqueness part of Theorem 
4.1, it is the only function satisfying them. Therefore, / = 0, that is, 


cryi{x 0 ) + C 2 y 2 {x 0 ) H-1- c n y n (x 0 ) = 0. 

Therefore, J/i, y 2 , ■ ■ ■ > Vn are linearly dependent. □ 


Corollary 4.5 

Let V be the set of solutions to Equation (4.1). Then we have dim(C) = n. 


Proof. Let V be the set of solutions to Equation (4.1). Pick a point x 0 £ R. 
Then by Theorem 4.1, given any numbers w\,w 2 , • ■ •, w n , there exists a unique 
solution of Equation (4.1) satisfying y^~ x \x 0 ) for j = 1,2,...,n. Let y-\ be 
such a solution with (wi,w 2 , • ■ •, w n ) = (0, 0,..., 0), let y 2 be such a solution 
with (wi,w 2 , • ■ •, w n ) = (0,1,..., 0), etc., finally letting y n be such a solution 
with ( wi,w 2 , • • •, w n ) = (0,0,..., 1). 

We claim that yi, y 2 , ■ ■ ■ , y n are linearly independent. Suppose that 


cryi(x) + c 2 y 2 {x ) H-1- c n y n (x ) = 0. 


Then differentiating gives 


Ciy[ 3 \x) + C 2 y 2 \x) H-h C n y%\x) = 0 
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for all j. In particular, 

ciyi\x 0 ) + c 2 y^\x 0 ) H-b c n y^\x 0 ) = 0 

for all j. Therefore, yi, y 2 , ■ ■ ■, y n are linearly independent and dim(C)) > n. 

Conversely, let y \,..., y n be linearly independent. Then W{y \,..., y n ) ( x ) yb 
0 for all x. Suppose that y € V and let 

y i0o) y -2 Oo) ••• y n {x 0 ) 

y'i(x 0 ) y' 2 {xo) ■■■ y' n (x o) 

M = 

. 2/i" _1) ( a; o) ^"^(so) ••• yn n_1) (a: o) 

Therefore, |Af| = |IT(a;o)| 0. So there exists constants (ci,C 2 ,..., c n ) such 

that 

y(x o) 

2/ ( ”~ 1) (x 0 ) 

that is, 

y {j \xo) = Cij/^ + c 2 2 / 2 J) -f-f- Ciy[ 3) 

for 0 < i < n — 1. Let f(x) = ciyi(a:) + c 2 y 2 (x) + ■ ■ ■ + c n y n {x). Then / is 
a solution to Equation (4.1) and y^\xo) = f^\xo) for j = 0,..., n — 1. By 
uniqueness, y = /, i.e., y(x) = Ciyi(a’) + c 2 y 2 {x) + • • • + c n y n {x). This means 
that y is a linear combination of y±,..., y n . So y \,..., y n forms a basis for V. 
Therefore, clim(E) = n. □ 

We conclude that, to solve Equation (4.1), we need to find n linearly in¬ 
dependent solutions 2 /-|,..., y n of Equation (4.1). Then the general solution to 
Equation (4.1) is c x yi + c 2 y 2 H-b c n y n . 

Example 4.6. Solve y" + 5 y' + 6y = 0. * 



Solution. It is easy to check that y = e 3x and y = e 2x each satisfies y" + 5 y' + 
6 y = 0. Therefore, the general solution is Cie 3 * + c 2 e 2x , where C\ and c 2 are 
arbitrary constants. 0 
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4.1.1 Linear Differential Equations with Constant Coeffi¬ 
cients 


The next problem concerns how to find the n linearly independent solutions. For 
n > 1, there is no good method in general. There is, however, a technique which 
works in the special cases where all the coefficients are constants. Consider the 
constant coefficient linear equation 

a 0 2 / (n) + aii/” -1) H-f a„_i y' + a n y = 0. (4.2) 

We first look for solutions of the form y = e Xx . If y — e Xx is a solution, then 
a 0 \ n e Xx + ai\ n ~ 1 e Xx + • • • + a n e Xx = 0. 

Now since e Xx yf 0, we have 

a 0 A n + aiA"- 1 + • • • + a n = 0. 


Let 

p(X) = a 0 A" + aiA" -1 H-ha„. (4.3) 

If Equation (4.3) has n distinct real roots ri, r 2 , ■ ■., r n , then we have n linearly 
independent solutions e riX ,e r2X ,... ,e r " x . We would like one solution for each 
root like this. 


Suppose that Equation (4.3) has a repeated real root r. Then we do not 
have enough solutions of the form e Xx . But consider y = xe rx . Then 

y ’ = re rx + rxe rx = (rx + 1) e rx , 

y" = re rx + r (rx + 1) e rx = (i' 2 x + 2 r) e rx , 

y'" = r 2 e rx + r ( r 2 x + 2r) e rx = ( r 3 x + 3 r 2 ) e rx , 


y(n) = ( r "x + nr” -1 ) e rx . 
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Substituting y = xe rx in Equation (4.2) gives us 


Y a k (r n ~ k x + (n - k) r n ~ k ) = Y xe rx 


k =0 


\fc =0 / 

\fc =0 / 

= p(r)xe rx + p\r)e TX . 


Since r is a repeated root of p, both p{r) = 0 and p'(r') = 0, that is, 


pW 


(X-r) 2 q(X) 


p\X) = 2 (A - r) q( A) + (A 
p\r ) = 0. 


r)V(A) 


Therefore, xe r * is also a solution of Equation (4.2). 

What about complex roots? They come in pairs, i.e., rq = a + ib and 
r 2 = a — ib, so e ( - a+lb ^ x and e ( a - zb )x satisfy Equation (4.2). But we want real 
solutions, not complex ones. But 

e (a+ib)x = R ax ( cos (fo.) + isin ( bx )) , 
e (a-ib)x = e ax _ j s in(6x)) . 


Let 


Z\ = e ax (cos (bx) + isin(bx )), 
z 2 = e ax (cos (bx) — isin(6x)). 

If z\ and zn are solutions, then 

ri * 22 = e ax cos (6a:), Zl ~ Z2 = e a * sin(6a;) 

are solutions. So the two roots a + ib and a — ib give two solutions e ax cos (bx) 
and e ax sin(6a;). For repeated complex roots, use xe ax cos(bx), xe ax sin(6x), etc. 
So in all cases, we get n solutions. 

The expression cie ax cos (bx) + e ax Ci sin(6a;) can be rewritten as follows. Let 
A = \/cf + c 2 . Then 
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that is, 

c °s (0) = , 2 Cl 2 , sin( 6 ») = sj\ - cos 2 ( 6 ») = 2 . 

V C 1 + c 2 V C 1 + c 2 

Therefore, 

Cie aa; cos (bx) + e aa: C 2 sin( 6 x) = Ae ax cos(bx ) + ^ sin(&a;)^ 

= Ae aa; (cos( 0 ) cos(bx) + sin( 0 ) sin( 6 x)) 

= Ae ax (cos {bx — 6)). 

Example 4. 7. Solve y^ - 4i/ 4 ) + 5'" + 6 " - 36 y' + 40 y = 0. * 

Solution. We have 

A 5 - 4A 4 + 5A 3 + 6 A 2 - 36A + 40 = 0, 

(A - 2 ) 2 (A + 2) (A 2 - 2A + 5) = 0. 

Therefore, A = 2,2, —2,1 ± 2 i and 

y = c\e 2x + C 2 xe 2x + cse~ 2x + c±e x cos( 2 a;) + C 5 sin( 2 a;), 

where 01,02,03,04,05 are arbitrary constants. {> 


4.2 Nonhomogeneous Linear Equations 

A nonhomogeneous linear equation is an equation of the form 

y {n) + Pi{x)y ( ' n ~ 1) + p 2 {x)y < ' n ~ 2) H - b p n (x)y = q(x). (4.4) 

Let Equation (4.1) (p.47) be the corresponding homogeneous equation. If u 
and v are solutions of Equation (4.4), then u — v is a solution of Equation (4.1). 
Conversely, if u is a solution of Equation (4.4) and v is a solution of Equation 
(4.1), then u + v is a solution of Equation (4.4). 

Let yi, y 2 , ■ ■ ■, y n be n linearly independent solutions of Equation (4.1) and 
let y p be a solution of Equation (4.4). If y is any solution to Equation (4.4), 
then y — y p is a solution to Equation (4.1), so 


V ~ U P = Oyi + c 2 y 2 H-b c n y n . 
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Therefore, 


y = oyi + c 2 y -2 H-b c n y n + y v 

is the general solution to Equation (4.4). 

Example 4.8. Solve y" — y = x. 


* 


Solution. The corresponding homogeneous equation is y" — y = 0. It then 
follows that A 2 — l = 0=t>A = ±l. Therefore, 


2/i = e x , 2/2 = e x . 

By inspection, y p = x solves the given equation. Therefore, the general solution 
is 

y = c x e x + c 2 e~ x - x, 

where c\ and c 2 are arbitrary constants. 0 

We will consider more systematically how to find y p later. 
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Chapter 5 

Second Order Linear 
Equations 

A second order linear equation is an equation of the form 

y" + P(x)y' + Q(x)y = R(x). (5.1) 

To find the general solution of Equation (5.1), we need 

• Two solutions: y\ and 2/2 of the corresponding homogeneous equation 
y" + P{x)y' + Q(x) = 0. 

• One solution: y p of Equation (5.1). 

Then the general solution is y = c\y\ + C 22/2 + Up, where ci and C 2 are arbitrary 
constants. 

Except in the case where P{x) and Q{x) are constants (considered earlier 
on p. 52), there is no general method of finding yi, but 

1. given y-[ , there exists a method of finding z/ 2 - 

2. given y\ and 2 / 2 , there exists a method of finding y p . 

We will discuss (1) first. 

5.1 Reduction of Order 

As mentioned earlier, we can find a second solution from the first. We first 
develop the tools we need. 
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Lemma 5.1 

Let /( x) be a twice differentiable function on a closed bounded interval 
J. If {x € J : f(x ) = 0} is infinite, then there exists an xq € J such that 
f{x o) = 0 and f(x 0 ) = 0 . 


Proof. Let S = {x G J : f(x) = 0}. If |5| is infinite, then by the Bolzano- 
Weierstrass Theorem, S has an accumulation point Xq, i.e., there exists an 
Xq £ S such that every interval about Xq contains another point of S. Therefore, 
by Rolle’s Theorem, every interval about Xq contains a point where f is 0. 
Therefore, by continuity, f'(x o) = 0.* □ 


Corollary 5.2 

Let yi(x) be a solution of y" + P{x)y' + Q{x)y = 0 on a closed bounded 
interval J. If y\ is not the zero solution, then y\ ( x ) = 0 for at most finitely 
many x in J. 


Proof. Let V be the set of solutions of y" + P{x)y' + Q(x)y = 0 on J. Then 
V is a two-dimensional vector space. So if y-\ ^ 0, then there exists a yi £ V 
such that 2/1 and y 2 are linearly independent. Therefore, Wfy\,y 2 ) 7 ^ 0, i.e., 
W(yi,y 2 ) is never zero (the Wronskian is either always 0 or never 0). But if 
yi(x) = 0 for infinitely many x in J, by Lemma 5.1, there exists an Xq £ J such 
that yi(xo) = 0 and y[ (xq) = 0. Therefore, 


W(y 1 ,y 2 )(x 0 ) 


yi (zo) y-2{xo) 


0 2/2 (x 0 ) 

y'i{xo) 2/2(*o) 


0 y' 2 {xo) 


This is a contradiction. Therefore, yi(x) = 0 for at most finitely many x in </.□ 


Let 2/1 a solution to y" + P(x)y' + Q(x)y = 0 on a closed bounded interval 
J. We want to find a linearly independent second solution 2 / 2 - 

We break J into a finite collection of subintervals so that 2/1 (x) 7 ^ 0 on the 
interior of each subinterval. We will describe how to find the second solution 2/2 

*Note that f is necessarily—but certainly not sufficiently—continuous if f is differen¬ 
tiable. 
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on the interior of each interval. This will define f /2 throughout J except for a 
few isolated points. 

Consider a subinterval / on which yi(x) is never zero. So y\(x) > 0 or 
y-iix) < 0 throughout I. We have 


W(y 1 ,y 2 ) 


y i i /2 
y'i 2/2 


If 2/2 is also a solution to y" + P(x)y r + Q(x)y = 0, then W = Ae f p ^ dx for 
some constant A (Albel’s formula).* Suppose we choose A — 1. Then 


2/12/2 - 2/i 2/2 = 


g -fP(x)dx, 


where y\ is known. This is a linear first order equation for y 2 . In standard form, 
we have 

y[ e ~ f p O)dx 


2/2 - 2/2 = 

2 /i 


2 /i 


where 2/1 7 ^ 0 throughout I. The integrating factor is 

J~£ - g-ln(|yi|)+C _ 9L 
~ 12 / 1 - 1 ' 

where C' = ±1, depending on the sign of j/i. We use 1 /z/i. Therefore, 
y' y' e~ / p ( x ) dx 

; - 2 2/2 = - 

2/i 2/1 


finally giving us 


2/2 

2/i 


2/2 = 2/i 


2/i 

0 — / -P(x) dx 

yf 


dx, 


da? 


2 /? 


dx. 


(5.2a) 


This defines y -2 on J except at a few isolated points where y\ = 0. At those 
points, we have 

/ / — r P(x) dx 

2 / 12/2 - 2 / 12/2 = e J , 


so 

- / P(x) dx 

2/2 =- 7 -■ (5.2b) 

2/i 

This defines y 2 are the boundary points of the subintervals. 


* Different A ’s correspond to different y 2 5 s. 
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Example 5.3. Observe that y = x is a solution of 

,, x + 2 . x 2 
y - y + —3~y = 0 


and solve 


x 2 . x 2 

2/- y H-o-y = a;e 

x x z 


Solution. Using the fact that j/i = x, we have 


/( l a )*' 


V2=X 


= X 


dx = . 


e /( 1 +f) da: 


dx = 


D ai+2 ln(|:r|) 


dx 


x z 

a;„2 ln(|*|) 


e e 


dx = x 


dx = x / e x dx = xe x 


x 


Therefore, 


W = 


From this, we have 


x xe 
1 e x + xe 11 


= xe I + xV-xe I = a;V. 


X, = -■ 


2 / 2 -R xe x xe x 

W x 2 e x 




, 7 /i f? xxe 1 


= 1 => U 2 = X. 


Therefore, 


y P = viyi + v 2 y 2 = ~xe x + x 2 e x , 


and the general solution is 

y = Cix + C 2 xe x — xe x + x 2 e x = Cix + C' 2 xe x + x 2 e x , x ^ 0, 
where Ci, C 2 , and C' 2 are arbitrary constants. 


5.2 Undetermined Coefficients 

Suppose that y\ and y 2 are solutions of y" + P{x)y' + Q{x)y = 0. The general 
method for finding y p is called variation of parameters. We will first consider 
another method, the method of undetermined coefficients , which does not always 
work, but it is simpler than variation of parameters in cases where it does work. 
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The method of undetermined coefficients has two requirements, that 

1. we have constant coefficients, i.e., P(x) = p and Q{x) = q for some con¬ 
stants p and q. 

2. R{x) is “nice”. 

Example 5.4. Solve y" — y = e 2x . * 

Solution. We have A 2 — 1 = 0. So y± = e x and y 2 = e~ x . Since R(x) = e 2x , we 
look for a solution of the form y = Ae 2x . Then 

y' = 2 Ae 2x , y" = 4,4e 2a: . 

Then according to the differential equation, we have 

4 Ae 2x - Ae 2x = e 2x =► A = -. 

'-.-' 3 

3 Ae 2x 


Therefore, the general solution is 

y = qe 1 + cae"* + ^e 2 ", 

where ci and c 2 are arbitrary constants. 0 

Undetermined coefficients works when P{x) and Q(x) are constants and 
R{x) is a sum of the terms of the forms shown in Table 5.1. 


Table 5.1: The various forms of y p ought to be given a particular R(x). 


R(x) 

Form of y p 

Cx n 

Aqx 71 + A\x n 1 + • • • + A n —\X + A n 

Ce rx 

Ae rx 

Ce rx cos(kx) 
Ce rx sin(fccc) 

Ae rx cos(kx) + Be rx sin (kx) 


The success of undetermined coefficients depends on the derivative of R(x) 
having some basic form as R{x). There is an easy way to deal with a complica¬ 
tion: whenever a term in the trial y p is already part of the general solution to the 
homogeneous equation, multiply it by x. For example, if we have y" — y = e x , 
as before, we have y\ = e x and y 2 = e 2x . Thus, we try y p = Axe 2x and find A. 
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Example 5.5. Solve y" + 3 y' + 2y = e x — 3. 


* 


Solution. We have A 2 + 3A + 2 = 0. Factoring gives (A + 2) (A + 1) = 0, so 
A € {—1, —2}, and we have yi = e~ x and y 2 = e~ 2x . Let y = Ae x + B. Then 
y' = Ae x and y" = Ae x , giving us 

y" + 3 y' +2 y = Ae x + 3Ae x + 2 Ae x + 2 B = 6Ae x + 2 B. 


Comparing coefficients with e x — 3, we have 

6A = 1=>A= 

6 

2B = —3 ==> B = 

2 

Therefore, y p = e x /6 — 3/2, and we have 


y = cie x + c 2 e 2x + ( — 
6 


3 

2 ’ 


where ci and c 2 are arbitrary constants. 


0 


Example 5.6. Solve y" + y = sin(a:). * 

Solution. We have A 2 + 1 = 0, so A = ±i, and it follows that y\ = cos(x) and 
3/2 = sin(a;). Let y = Arsin(;r) + Bx cos(x). Then 

y' = ^ 45111 ( 0 ;) + Arcos(x) + B cos(x) — Bx sin(x) 

= {A — Bx) sin(x) + (Ax + B ) cos(a:), 
y" = —B sin (a:) + (A — Bx) cos(a:) + Acos(a;) — (Ax + B) sin(a:) 

= (—Ax — 2B) sin(a;) + (2A — Bx) cos(x). 


Therefore, 


y" + y = (—Ax — 2B) sin(cc) + (2 A — Bx) cos(x) + Arsin(:r) + Bxcos(x). 
Comparing coefficients with sin(a;), we see that 


-2B = 1 


S = -2’ 
A = 0. 


2A = 0 
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Therefore, y p = — a:cos(x)/2, and the general solution is 

... . . a: cosier) 

y = Ci sin (a;) + ci cos(;r)---, 

where c\ and C 2 are arbitrary constants. 0 

Example 5.7. Solve y" - Ay = x 1 . * 

Solution. We have A 2 — 4 = 0, so A = ±2, and it follows that yi = e 2x and 
j /2 = e~ 2x . Let y = Ax 2 + Bx + C. Then y' = 2 Ax + B and y" = 2 A. Therefore, 

y" -Ay = 2A- 4 Ax 2 - AB - 4C = -4 Ax 2 + Ox + (2 A -IB- AC). 


Comparing coefficients with x 2 , we immediately see that 


-AB = 0 => B = 0, 
2A-AC = 0=^C=^- = 


-1/4 

2 


1 

8 ' 


Therefore, y p = —x 2 /A — 1/8, and the general solution is 


y = cie + c 2 e - — 


1 

8 ’ 


where C\ and C 2 are arbitrary constants. 0 

Example 5.8. Solve y" — y' = x. * 

Solution. We have A 2 — A = 0, so A € {1,0}, and it follows that y-\ = e x and 
j /2 = 1. Let y = Ax 2 + Bx. Then 1 / = 2 Ax + B and y" = 2 A. Therefore, 


y" - y = 2A - 2Ax - B. 


Comparing coefficients with x, we immediately see that 


-2A= 1 =^A = -~, 
2 ’ 

2A- B = 0 =>• B = -1. 


Therefore, y p = -x 2 /2 — x, and the general solution is 

x 2 

y = cie^ + c 2 - — - x, 
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where c\ and C 2 are arbitrary constants. 


0 


5.2.1 Shortcuts for Undetermined Coefficients 

Suppose we have 

y" + ay 1 + by = R(x). 

Let p( A) = A 2 + aX + b. We now consider two cases for R(x). 

Case I: R(x) = ce ax . It follows that y p = Ae ax , so y' = a^ 4 e ax and 
y" = aAe ax . Then 

y" + ay' + by = ce ax 
( a 2 + aa + b) Ae ax = p(a)Ae ax . 

Therefore, A = c/p(a), unless p(a) = c. 

What if p(a) = 0? Then e ax is a solution to the homogeneous equation. Let 
y = Axe ax . Then 

y' = Ae ax + Aaxe ax , 

y" = A(xe ax + Aae ax + Aa 2 xe ax = 2 Aae ax + Aa 2 xe ax . 

Thus, 

y" + y' + y = A [(a 2 x + aax + b) + 2a + a] e ax 
= A(p{a)xe ax + p' (a)e ax ) 

= Ap\a)e ax . 

Therefore, A = c/p'{a), unless p'{a) = 0 too. 

If p(a) = 0 and p'(a ) = 0, then e ax and xe ax both solve the homogeneous 
equation. Letting y = Ax 2 e ax , we have A = c/p" (a). 

Case II: R(x ) = ce rx cos(bx) or ce rx sin (bx). We use complex numbers. Set 
a = r + ib. Then 

ce ax = ce rx cos(bx) + ice rx sin (bx). 

Let z = y + iw. Consider the equation 


z" + az’ + bz = ce ax . 


(5.3) 
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The real part and imaginary parts are 


y" + ay' + by = ce rx cos (foe), 
w" + aw' + bw = ce rx sin(foc), 


(5.4a) 

(5.4b) 


respectively. The solutions of Equation (5.3,5.4a,5.4b) are then 


ce / ce^ 
z =-TRi y = Re —- 
p(a) \P(at) 


w = Im 


p(a)J ’ 


respectively. 

Example 5.9. Solve y" + 8 y' + 12 y = 3cos(2x). * 

Solution. We have p( A) = A 2 + 8 A + 12 = (A+ 2) (A+ 6 ). Therefore, A G 
{—2, — 6 } and it follows that y-\ = e~ 2x and y 2 = e~ 6x . So 

_ 3e 2ix _ 3e 2ix _ 3e 2ix 
p(2i) ~ (2 i) 2 + 16* + 12 _ -4 + 16* + 12 


3e 2ix 3 1 2ix 3 1-2 * 2 

8 + 16 * " 8 ' 1 + 2* 6 ~ 8 ' (1 - 2 *) (1 + 2*) 6 
3 1 — 2* oix ^ . 2te 


= - . = — n _ 2i) e 2 “ 

8 1 + 2* 40 ' ; 

3 

= — (1 — 2 *) (cos( 2 x) + *sin( 2 a;)) 

3 

= — [cos( 2 a;) + 2 sin( 2 a;) + * (— 2 cos( 2 cr) + sin( 2 a;))]. 


Therefore, 


3 3 

Re(z) = — (cos(2x) + 2sin(2cc)), Im(z) = — (—2cos(a;) + sin(2a;)). 

Hence, the solution is 


y = C\e x + c 2 e bx + — (cos(2x) + 2 sin(2a;)), 


where Ci and c 2 are arbitrary constants. 


We conclude that there is no shortcut when R(x) is a polynomial or any 
multiple of a polynomial. 
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5.3 Variation of Parameters 


Consider the equation 


y” + P(x)y' + Q(x)y = R(x), (I) 

where P(x) and Q(x) are not necessarily constant. Let y\ and y 2 be linearly 
independent solutions of the auxiliary equation 

y" + P(x)y' + Q{x)y = 0. (H) 

So for any constants C\ and C 2 , Cryi + C^yi satisfies Equation (H). 

The idea of variation of parameters is to look for functions tq(x) and v 2 (x ) 
such that Viy± + v 2 y 2 satisfies Equation (I). Let yi and 2 / 2 - If we want y to 
be a solution to Equation (I), then substitution into Equation (I) will give one 
condition on v\ and v 2 - 

Since there is only one condition to be satisfied and two functions to be 
found, there is lots of choice, i.e., there are many pairs V\ and V 2 which will 
do. So we will arbitrarily decide only to look for iq and V 2 which also satisfy 
v[yi + v' 2 y 2 = 0. We will see that this satisfaction condition simplifies things. 
So consider 


V = Viyi + v 2 y2, 

y = viyi + V2y' 2 + v[yi + v^yi = v x y\ + v 2 y2, 
y" = v x y'[ + v 2 y2 + v'\ y[ + v' 2 y2- 

To solve Equation (I) means that 

/ Vxy’l + v 2 y'f + viyi + VW2 + -POMyi \ = R ,, 
\ +P{x)v 2 y 2 + Q{x)v\y\ + Q{x)v 2 y2 ) 

1 V! (y" + P{x)y' l + Q(x)yi) \ 

+V2 {y 2 + P{x)y' 2 + Q(x)y 2 ) = R(x). 

\ +vWi + ^yi ) 


Therefore, 


viyi + viyi = R{x), 
viyi + viyi = °> 
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and it follows that 


where 


2/2 R 

‘ W ’ 


yiR 

w ’ 


w = 


y i z/2 
y'i 2/2 


7^ o, 


i.e., it is never zero regardless of a;, since y-| and t /2 are linearly independent. 
Example 5.10. Solve y" — 5 y' + 6 y = x 2 e 3x . 

Solution. The auxiliary equation is 

y" - by' + by = 0 A 2 - 5A + 6 = 0 => A = 3,2. 

Therefore, the solutions are y\ = e 3x and = e 2x . Now, 


W = 


2 /i 

2/2 


e 3x e 2x 

y'i 

2/2 


Se 3x 2e 2x 


= 2e 5x - 3e oa: = -e 


5x 


Therefore, 


2/2 R 


Vi = 




1 W —e 5x 3 

We can use any function v\ with the right v\ , so choose the constant of integra¬ 
tion to be 0 . 

For V 2 , we have 


y\R 

W 


—e 


5x 


= -x 2 e x , 


so 


V 2 = — I x 2 e x dx = —x z e x + 2 / xe x dx 


2 x 


by parts by parts 

= —x 2 e x + 2xe x — 2 j e x dx 

= x 2 e x + 2xe x - 2e x 
= - {x 2 - 2x + 2) e x . 


y p = ~^~ e3x ~ (x 2 ~2x + 2) e x e 2x = e 3x — x 2 + 2x — 2 ^ , 


Finally, 
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and the general solution is 


y = Cie ix + C 2 e IX + e 2x ( — - x 2 + 2x - 2 

O 


= e ix — - x 2 + 2x - 2 + Ci + C 2 e 


= — - a- 2 + 2x + Ci e^ x + C 2 e 2x , 


where C\ and C 2 are arbitrary constants. 


0 


Example 5.11. Solve y" + 3 y' + 2 y = sin(e x ). 


* 


Solution. We immediately have A 2 + 3A + 2 = 0, which gives A € {— 1, —2}. 
Therefore, y\ = e~ x and y 2 = e~ 2x . Now, 


W = 


—2e~ 


= — 2 e 


—3x 


e~ 3x = —e~ 3x . 


Therefore, 


Vi =-- 


e 2x sin(e x ) 


—e 


— 3x 


= e x sin(e x ) ==> v\ = — 008 ( 6 *). 


For v 2 , we have 

Therefore, 


, e x sin(e x ) 

W 2 = _ p -3x 


= -e 2x sin(e x ). 



substitute t = e x by parts 


t cos(t) 


cos (t) dt 


= — (—tcos(t) + sin(f)) 
= e x cos(e x ) — sin(e x ). 
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Finally, 


Up = viyi + V 2 U 2 

= —e~ x cos(e x ) + e" 2x (e x cos(e x ) - sin(e x )) 

= —e~ x cos(e x ) + e~ x cos(e x ) - e" 2x sin(e x ) 

= —e _2x sin(e x ), 

and the general solution is 

y = C ie ~ x + C 2 e~ 2x - e" 2x sin(e x ), 

where C\ and C 2 are arbitrary constants. {> 
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Chapter 6 

Applications of Second 
Order Differential 
Equations 


We now look specifically at two applications of first order De’s. We will see that 
they turn out to be analogs to each other. 


6.1 Motion of Object Hanging from a Spring 

Figure 6.1 shows an object hanging from a spring with displacement d. 



Figure 6.1: An object hanging from a spring with displacement d. 


The force acting is gravity, spring force, air resistance, and any other external 
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forces. Hooke’s Law states that 

^spring = kd, (6.1) 

where F is the spring force, d is the displacement from the spring to the natural 
length, and k > 0 is the spring constant. As we lower the object, the spring 
force increases. There is an equilibrium position at which the spring and grav¬ 
ity cancel. Let x be the distance of the object from this equilibrium position 
measured positively downwards. Let s be the displacement of the spring from 
the natural length at equilibrium. Then it follows that ks = mg. 

If the object is located at x, then the forces are 

1. gravity. 

2. spring. 

3. air resistance. 

4. external. 

Considering just gravity and the spring force, we have* 

Fgravity T F S p r j n g == mg k (x s) — kx. 

Suppose air resistance is proportional to velocity. Then 

Fair = -rv, r > 0. 

In other words, the resistance opposes motion, so the force has the opposite sign 
of velocity. We will suppose that any external forces present depend only on 
time but not on position, i.e., F externa i = F(t). Then we have 

Ftotai = ~kx -rv + F(t), 

ma 

so it follows that 

m w +rd i +kx = F ^ ^ 

Therefore, m\ 2 + r A + k = 0 and we have 

^ — r ± sjr 1 — Amk r / r \ 2 k 

2 m 2 m V V2 mJ m 

* Intuitively, when x = 0, they balance. Changing x creates a force in the opposite direction 
attempting to move the object towards the equilibrium position. 
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We now have three cases we need to consider. 

Case 1: 4 mk > r 2 . Let a = r/2m, let w = \Jk/m , and let 



Then A = — a ± i(3 and 

x = e~ at (Ci cos (fit) + Ci sin (fit)) = Ae~ at cos (fit — 9 ), (6.3) 

where Ci and Ci are arbitrary constants. Figure 6.2a shows how this solution 
qualitatively looks like. 

Damped vibrations is the common case. The oscillations die out in time, 
where the period is 2ir//3. If r = 0, then a = 0. In such a case, there is no 
resistance, and it oscillates forever. 

Case 2: 4 mk = r 2 . In such a case, we simply have 

x = e-^ t (C 1 + C 2 t), (6.4) 

where Ci and C 2 are arbitrary constants. Figure 6.2b shows how this solution 
qualitatively looks like. 

Case 3: Amk < r 2 . Let a = r/2m and 

/ r \ k 
\2mJ m 

Then the solution is 

x = Cie- (a " fe)t + C 2 e- (o+h)t , (6.5) 

where Ci and C 2 are arbitrary constants. This is the overdamped case. The 
resistance is so great that the object does not oscillate (imagine everything 
immersed in molasses). It will just gradually return to the equilibrium position. 
Figure 6.2c shows how this solution qualitatively looks like. 

Consider Equation (6.2) again. We now consider special cases of F(t), where 

F(t) = 



F 0 cos 
F 0 sin(w<). 
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(b) 4 mk = r 2 



Figure 6.2: The various cases for a spring-mass system. 


Use undetermined coefficients to get the solution of the form 

x p = B cos (cot) + C sin(wt). 


For F(t) = F 0 cos(cot), we get 
F 0 

x p = - —2 - 2 [(& — moJ ) cos (cut) + rwsin(wf)] = 7Lcos(wf — S) , 

(k — mw 2 ) + (rw) 


where 


A = 

cos (<5) = 
sin(<5) = 


_ Fo _ 

\J\k — mix 2 ) 2 + (rw) 2 
k — mu 2 

\J\k — mw 2 ) 2 + (rw) 2 
rw 

\J\k — mw 2 ) 2 + (rw) 2 


For F(t) = F 0 sin(wt), we get x v — 7lsin(wt — S ), where A and <5 is as above. 
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In any solution 


e at (*) + A sin(uA — 6) , 


the first term eventually dies out, leaving Asin(wf — S) as the steady state so¬ 
lution. 

Here we consider a phenomenon known as resonance. The above assumes 
that cos (cot) and sin (art) are not part of the solution to the homogeneous equa¬ 
tion. Consider now 


cUx 

m—- 7 r + kx = Fq cos (cat), 
dt z 


where lo = \fkjrn (the external force frequency coincides with the natural 
frequency). Then the solution is* 


F n 


2 y/km 


tsm(cot). 


Another phenomenon we now consider is beats. Consider r = 0 with lo near 
but not equal to yjk/m. Let Co = y/k/m. Then the solution, with x(0) = 0 = 
a/(0), is 


x = ——-z -COS (u)t - Cat) 

m (ca z — ca z ) 


2Fn 


(O + ta) (Co — lo) 
F 0 


sin 


(lo — Co) t\ . f (lo + Co) t 


sin 


2 Loem 

where e = (to — Co) /2. 


sin (et) sin (cot), 


6.2 Electrical Circuits 


Consider the electrical circuit shown in Figure 6.3. 

Let Q(t) be the charge in the capacitor at time t (Coulombs). Then cLT/dt 
is called the current, denoted I. The battery produces a voltage (potential 
difference) resulting in current / when the switch is closed. The resistance R 
results in a voltage drop of RI. The coil of wire (inductor) produces a magnetic 
field resisting change in the current. The voltage drop created is L (dl/dt). The 


*The amplitude of the vibrations is 


F 0 


‘lyjkm 


t , 


which increases with time. 



76 CHAPTER 6. APPLICATIONS OF SECOND ORDER DIFFERENTIAL EQUATIONS 


resistor 


battery 



inductor 


Figure 6.3: An electrical circuit, where resistance is measured in Ohms, capac¬ 
itance is measured in Farads, and the inductance is measured in Henrys. 


capacitor produces a voltage drop of Q/C. Unless R is too large, the capacitor 
will create sine and cosine solutions and, thus, an alternating flow of current. 
Kirklroff’s Law states that the sum of the voltage changes around a circuit is 
zero, so 

, , d.1 Q 

E(t) + RI + L— + —, 


so we have 



j,dQ Q 
R dt + C 


E(t). 


( 6 . 6 ) 


The solution is the same as in the case of a spring. The analogs are shown in 
Table 6.1. 


Table 6.1: Analogous terms between a spring-mass system and an electrical 
circuit. 


Circuit 

Spring 

Charge Q 

Displacement x 

Inductance / 

Mass m 

Resistance R 

Friction r 

Capacitance inverse 1/C 

Spring constant k 

Voltage generated by battery E(t) 

External force F{t) 

Amperes / 

Velocity v 


An example of this application is choosing a station on an old-fashioned 
radio. The radio has a capacitor with two charged metal bars. When the 
user turns the tuning dial, it changes the distance between the bars, which in 
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turn changes the capacitance C. This changes the frequency of the solution 
of the homogeneous equation. When it agrees with the frequency E(t) of some 
incoming signal, resonance results so that the amplitude of the current produced 
from this signal is much greater than any other. 
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Chapter 7 

Higher Order Linear 
Differential Equations 


In this section we generalize some of the techniques for solving second order 
linear equations discussed in Chapter 5 so that they apply to linear equations 
of higher order. Recall from Chapter 4 that an nth order linear differential 
equation has the form 

V {n) + P\{x)y^ nV> + P 2 (x)y {n ~ 2) + • • • + P n (x)y = Q(x). (7.1) 


The general solution is 

y = Ciyi + C-2y-2 + • • • + C n y n + y p , 

where yi, y %,..., y n are linearly independent solutions to the auxiliary homoge¬ 
neous equation and y p is a solution of Equation (7.1). 

So given y\, y- 2 , ■ ■ ■, y n , how do we find y p l We again consider the two meth¬ 
ods we have looked at in §5.2 and §5.3 (p. 60 and p. 66, respectively). 


7.1 Undetermined Coefficients 

If P\(x),P 2 (x ),..., P n (x) are constants and R(x) is “nice”, we can use undeter¬ 
mined coefficients. 

Example 7.1. Solve j/ 4 ) — y = 2e 2e + 3e x . * 
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Solution. We have 


p( A) = A 4 - 1 = (A - 1) (A + 1) (A 2 + 1) . 


Therefore, 


Vi = e x , V 2 = e x , 2/3 = cos (a:), y 4 = sin(a;). 


Let y p = Ae 3x + Bxe 3x . Then by the short cut method (§5.2.1, p. 64), we have 

A- 2 _ 2 2 

“ p{ 2) " 16-1 " 15’ 

B _ 3 _ 3 _3 

p'{ 1) 4-l 3 4' 

Therefore, the general solution is 

y = C\e x + C 2 e~ x + C 3 cos(x) + C 4 sin(a;) + ^e 2x + ^-xe x . A 

15 4 v 


7.2 Variation of Parameters 


Suppose that yi,y 2 ,. ■ ■, y n are solutions of the auxiliary homogeneous equation. 
We look for solutions of Equation (7.1) of the form 


y = viyi + v 2 y 2 H-h v n y n , 

where Vi, v 2 ,..., v n are functions of x. One condition on v\,v 2 ,..., v n is given 
by substituting into Equation (7.1). We choose n — 1 conditions to be 

v[yi + v'. 2 y 2 H-h v' n y n = 0 , ( 1 ) 

vWi + v[y 2 H-h v' n y' n = 0 , ( 2 ) 

v[ y[ n ~ 2) + v' 2 y^ 2) + • • • + v' n y { ™~ 2) = 0. 


(n- !) 
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If conditions (1),..., (n — 1) are satisfied, then 

n n n n 

y' = Y {ViViY = Y V iVi + Y V i yi = E Viy i ’ 

2=1 i—1 2=1 i—1 

Tb Tt Tb Tb 

y" = Y M' = E Viy " + Y v i y i = Y Viy "> 

i—1 i—1 i—1 i—1 


y K " = Y ViV ' 

i =1 

n 

y y "’ = Y lhy i 

i=l 


(n—1) \ A (n—1) . \ ^ / (n—2) \ A (n— 1) 

v ; = n v ' = 2^ v w » 


Y V i y i 

i=l 


Therefore, 

n n 

y (n) + Pi(a;)2/ ( " _1) H-h P„(a;)y = EW^ + E^"”^ 


2=1 


2=1 




= E 


2=1 




2=1 




?/i n) +Pi(a;)y{" ^ + • • • 



= E v i y i 


E l (n-l) 
ViVi • 


Therefore, Equation (7.1) becomes the first condition 


E^i" = #(*)• 


UiJ/i 


(n) 
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Conditions (1),..., (ra — 1) can be written as 




0 

v '2 

= 

0 

. V 'n . 


R{x) 


where 


M = 


V i 

y'\ 


(n— 1) 

y\ 


Therefore, \M\ = W ^ 0. 


IIn 

yn 


yk 


-i) 


7.3 Substitutions: Euler’s Equation 


Consider the equation 

x n y (n) + aix" - V" -1) H-h a n _i y' + a n y = R(x), (7.2) 


where ai, 02 ,..., a n are constants. Consider x > 0. Let x = e u so that u = ln(x) 
(for x < 0, we must use u = ln(— x)). Then 


dy dy du dy 1 

dx du dx dux 1 

d 2 y d 2 y 1 dy 1 / d 2 y dy\ 1 

dx 2 du 2 x 2 du x 2 \ du 2 du ) x 2 1 

d 3 y ( 3 o d 2 y\ 1 (d 2 y dy\ 1 

fa 3 = \d V X ' ~ d^ 2 ) ^ “ (dt? “ du) 

= (d 3 y d 2 y dy\ l_ 

\ du 3 du 2 du) x 3 ' 


d n y fdT^ c d n 3 y c dy\ 

dx n \du n 1 du n ~ 1 n du) x n 
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for some constants C\, C 2 , ■ ■ ■, C n . Therefore, Equation (7.2) becomes 


d ^y + b dn ~ ly 

du n 1 du n ~ l 
for some constants bi, b 2 , • • •, b n . 


dy 

+ 0 „_i— + b n y 
du 


R(e u ) 


Example 7.2. Solve x 2 y" + xy' — y = x 3 for x > 0. 


* 


Solution. Let x = e u so that u = ln(a;). Then 

dy dy du dy 1 
dx du dx du x ’ 

d 2 y d 2 y 1 dy 1 / d 2 y dy\ 1 

dx 2 du 2 x 2 du x 2 \ du 2 du J x 2 


Therefore, 


d 2 y _ dy_ 
du 2 du 


h dj, 

du 

d 2 u 

du 2 


y = e 


3 u 


y = e 


3 u 


Considering the homogeneous case, we have A 2 — 1 = 0 => A = ±1. Therefore, 
2 /i = e“ and y -2 = e~ u . Using undetermined coefficients, let y v = ^4e 3 “. Then 
2 / = 3 Ae 3u and y" = 9 Ae 3u . Substitution gives 


9 Ae 3u - Ae 3u = e 3u . 


8Ae 3u 


We can immediately see that A — 1/8. Therefore, the general solution is 


y = Cie“ + C 2 e-“ + ^e 3 “ 


= C 1 e ln(a:) + C 2 e~ ln(x) + le 31n(x) 
= C lX 


Co x 3 


x 8 

where Ci and C 2 are arbitrary constants. 


We can also consider a direct method. Solving 
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involves looking for solutions of the form y = e Xw = (e“) A and finding A. Since 
x = e u \ we could directly look for solutions of the form x x and find the right A. 
With this in mind and considering Example 7.2 again, we have 

y = x x , 

V = Az A -\ 

y" = A (A — 1) x x ~ 2 . 

Therefore, 

x 2 y" + xy' — y = 0 => A (A — 1) x x + \x x — x x = 0 
=> A(A — 1) + A—1 = 0 
=> A 2 - 1 = 0 
A = ±1, 


as before. 



Chapter 8 

Power Series Solutions to 
Linear Differential 
Equations 

8.1 Introduction 

Consider the equation 

y {n) + Pi{x)y {n - X) + • • • + P n (x)y = R(x). (8.1) 

Given solutions y \,..., y n to the homogeneous equation 
y ( ") + Pi{x)y H-h P n y = 0, 

we know how to solve Equation (8.1), but so far there is no method of finding 
j/i,..., y n unless , P„ are constants. In general, there is no method of 

finding yi,. ..,y n exactly, but we can find the power series approximation. 

Example 8.1. Solve y" — xy' — 2y = 0. * 


Solution. Let 

OO 

y = do + a±x + a 2 X 2 + • • • + a n x n + • • • = a n x n . 

n =0 
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Then it follows that 


y' = a\ + 2a 2 x + • • • + na n x n 1 + (n + 1) a n +\X n + ■ 

OO 

n-l _ \ ' a I 1U. 


= na n x n 1 = ^ (fc + 1) ak+ix", 

n —1 fc—0 

where k = n — 1. Relabeling, we have 


y' = ^2 (n+ 1) an+iX™ 

n —0 


By the same procedure, we have 


V 


= ( n + 1 ) a n+iX n 1 = ^ (n + 1) [n + 2) a n+2 x n . 


n —0 n =0 

Now considering y" — xy' — 2y = 0, we have 

2/" 2/' 


n —0 


(n + 1) (n + 2) a n+ 2 x" —x ^ na n x n 1 —2 ^ a„x™ = 0, 

n—0 n=0 

oo 

[(n + 1) (n + 2) a „+2 — na ra — 2a„] x” = 0. 


n—0 


This gives us the recurrence relation 


(n + 1) (n + 2) a n+2 - na n - 2a n = 0, 
(n + 1) (n + 2) a „+2 - (n + 2) a n = 0, 


(n + 1) a„ +2 = a n , 


O-n+2 


Un 

n + 1 


for all n > 0. Therefore, 


a 0 a 2 

02 = T’ a4 = y = i 


a i 

«3 = y, 


Qq 
• 3’ 

ai 


a3 

° 5 _ 4 _ 2 • 4 ’ 


a4 ao 

5 1 • 3 • 5 

_ a 5 _ a l 
° 7 _ ~6~ ~ 2-4-6’ 


«2n — 


ao 


mu (2fc—i) * 

ai 


mu2fc- 


a2ra+l ^ 
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Therefore, 


y = a o + ciix + ci 2 X 2 + a^x 3 + • • • + a n x n + ■ 

a 0 


2 o 

= a a + w+v + -z + ... + m - w - Yf n „_ iM 


_ x 2n+1 


— CLq ( 1 + X + • • • + 


mu (2^-1) 


x 3 x 2n+1 

+ “‘ |I+ y + " + nLf» 


■“" E rc. I ( 2 t-D + “ lS 


°° x 2n+l 


2 n n\ ' 


n= 0 ix k— 1v ' n=0 

That is, we have y = C\y\ + C 21 / 2 , where C\ = a 0 and C 2 = ai such that 


2 /i 


E 


nLi(2fc-ir 


2/2 


= E 


°° . x 2 n+l 


n—0 


2"n! 


Can we recognize 1/1 and 1/2 as elementary functions? In general, no. But in 
this case, we have 


00 x 2n +1 


2 n 


2/2 


(* 2 ) r 


= V -_= * V — = x V v ; = x V 

^ 2 n rc! ^ 2"n! ^ 2"n! ^ 

n=0 n=0 n—0 n=0 


(x 2 / 2 ) r 


2 /2 


n! 


Having one solution in closed form, we can try to find another (see §5.1, p. 57) 
by 


f P(x ) dx 


2/1 = 2/2 


2/1 


2/2 


f P(x) dx 


= xe x2 ' 2 


0 x 2 /2 


dec = xe * 2 / 2 


1 


x 2 e x 2 /2 


dx 


dx, 


which is not an elementary function. 


0 
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8.2 Background Knowledge Concerning Power 
Series 


Theorem 8.2 

Consider the power series a-n ( z ~ P)”- 

1. There exists an R such that 0 < R < oo called the radius of con¬ 
vergence such that ( z ~~ p)" converges for \z — p\ < R and 

diverges for \z — p\ > R. The radius of convergence is given by 


R = lim 

n—*oo 


a n 

Ura+l 


( 8 . 2 ) 


if the limit exists (ratio test). 

2. The function f(z) = a n~ n defined for \z — p\ < R can be differ¬ 

entiated and integrated term-wise within its radius of convergence. 


Proof. Proof is given in MATA37 or MATB43. □ 

Remark. The series may or may not converge when \z — p\ = R. 0 

Using (2) of Theorem 8.2, f'(z) exists for \z — p\ < R with f'(z) = na n z n ~ l . 

Similarly, 

OO 

f{z) = ^2a n {z- p) n , 

n= 0 
oo 

f( z ) = X ! nan ( z ~ p )” _1 > 

n= 0 
oo 

f"( z ) = n ( n -1 ) a ” - p)” - 2 i 

n—0 


z = p=> a 0 = f(p ), 


z = p=> ai = f(p), 

__ r(p) 

z = p=> a 2 = 


f( n \ z ) = a - 

n =0 


Z = p 


/ (n) (p) 

n\ 
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Conversely, if / is infinitely differentiable at p , we define a n = f^ n \p)/n\. Then 
a n i z — P) n is called the Taylor series of / about p. 

From the above, if any power series converges to f near p, it must be its 
Taylor series. But 

1. the Taylor series might not converge. 

2. if it does converge, it does not have to converge to /. 


Definition (Analytic function, ordinary /singular point) 

A function / is called analytic at p if a n (z — p) n converges to f(z ) in 

some neighbourhood of p (i.e., if there exists an r > 0 such that it converges for 
\z — p\ < r). If / is analytic at p, then p is called an ordinary point of /. If / 
is not analytic at p, then p is called a singular point of /. 


Theorem 8.3 (Theorem from complex analysis) 

Let f(z) be analytic at p. Then the radius of convergence of the Taylor 
series of / at p equals the distance from p to the closest singularity of f in 
the complex plane. 


Proof. Proof is given in MATC34. □ 

Example 8.4. Consider f(x) = 1/ ( x 2 + l). The singularities are ±i. There¬ 
fore, the radius of convergence of the Taylor series about the origin is 1, with 
the series given by 

OO 

/(*) = £(- 1 )"* 2 "- 

71 =0 

The radius of convergence of the Taylor series about x = 1 is x/2. * 


8.3 Analytic Equations 

Consider y" + P(x)y' + Q{x)y = 0. If both P(x) and Q(x) are analytic at p, 
then p is called an ordinary point of the DE. Otherwise, p is called a singular 
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point or a singularity of the de. When looking at a DE, do not forget to write 
it in the standard form. For example, 

x 2 y" + by' + xy = 0 

has a singularity at x = 0 , since the standard form is 

Theorem 8.5 

Let x = p be an ordinary point of y" + P{x)y' + Q{x)y = 0. Let R be the 
distance from p to the closest singular point of the de in the complex plane. 
Then the DE has two series yi(x) = Y2Y= o a nX n and y 2 (x) = Yin =o^nX n 
which converge to linearly independent solutions to the de on the interval 
\x — p\ < R. 

Remark. The content of the theorem is that the solutions are analytic within 
the specified interval. The fact that solutions exist on domains containing at 
least this interval is a consequence of theorems in Chapter 10. {> 


Proof. The proof is given in Chapter 10. 


□ 


Example 8 . 6 . Consider ( x 2 + l) y" + 2xy' + 2y = 0. Dividing by x 2 + 1, we 
have 

,, 3x , 2 

y + 9 , i y + 9 , i y = °- 


X 1 + 1* 


X 2 + 1' 


The singularities are ±i. If p = 0, then r = \i — 0| = 1. Therefore, analytic 
solutions about x = 0 exist for \x\ < 1. If p = 1, then r = \i — 1| = y/2. There¬ 
fore, there exist two linearly independent series of the form YlY=o a ” ( x ~ 1 )” 
converging to the solutions for at least \x — 2| < y/2. 

Note that the existence and uniqueness theorem (see Chapter 10) guarantees 
solutions from —oo to oo (since x 2 + 1 has no real zeros), but only in a finite 
subinterval can we guarantee that the solutions are expressible as convergent 


power series. 


* 


Example 8.7. Consider y" — xy' — 2y = 0. It has no singularities. Therefore, 
a series solution converging on R exists about any point. * 
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8.4 Power Series Solutions: Levels of Success 

When using power series techniques to solve linear differential equations, ideally 
one would like to have a closed form solution for the final answer, but most often 
one has to settle for much less. There are various levels of success, listed below, 
and one would like to get as far down the list as one can. 

For simplicity, we will assume that we have chosen to expand about the 
point x = 0, although the same considerations apply to x = c for any c. 

Suppose 0 is an ordinary point of the equation L(x)y" + M (x)y'+ N (x)y = 0 
and let y = Y2Y=o a nX n be a solution. One might hope to: 

1. find the coefficients a n for a few small values of n; (For example, find the 
coefficients as far as a 5 which thereby determines the 5th degree Taylor 
approximation to y{x))\ 

2. find a recursion formula which for any n gives a „+2 in terms of a„_i 
and a n \ 

3. find a general formula a n in terms of n; 

4. “recognize” the resulting series to get a closed form formula for y(x). 

In general, level (1) can always be achieved. If L(x), M[x ), and N(x) 
are polynomials, then level (2) can be achieved. Having achieved level (2), it 
is sometimes possible to get to level (3) but not always. Cases like the one 
in Example 8.1 where one can achieve level (4) are rare and usually beyond 
expectation. 


8.5 Level 1: Finding a finite number of coeffi¬ 
cients 

Suppose c is an ordinary point of Equation (8.3). One approach is to finding 
power series solutions is as follows. Expand P(x) and Q(x) into Taylor series 

OO OO 

P(x ) = Pn ( x “ c )" > Q( x ) = 5Z ( x ~ c )" • 

n —0 n —0 

and set y = a n (x — c) n solves the equation. Then 

OO OO 

y' = ^ na n {x - c ) n ~ l , y" = ^ n (■n - 1) a n x n ~ 2 , 

n —0 n—0 
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and Equation (8.3) becomes 


v 


P(x 


^ n (n - i) 


a n x 


n —2 


n —0 


+ (m Pn ( x ~ c ) n ) (5Z nan ( x ~ c ) n 1 ) 

\n=0 / \n—0 J 

\-(^2 q n ( x - c)A (^ a n (x - A = 0. 


Vn—0 


\n —0 


Q(x 


Since Pn s and q n ’s are known (as many as desired can be computed from deriva¬ 
tives of P(x) and Q(x)), in theory we can inductively find the a n ’s one after 
another. 

In the special case where P{x) and Q(a;) are polynomials, we can get a 
recursion formula by writing a n +2 in terms of a„ and a n - 1 (level 2) and, under 
favourable circumstances, we can find the general formula for a n (level 3) as in 
Example 8.1. But in general, computation gets impossibly messy after a while 
and, although a few a n ’s can be found, the general formula cannot. 

But if you only want a few a n ’s, there is an easier way. We have a n = 
y(")(c)/n!, so 


a 2 = 


y"(c) _ P(x)y'(c) + Q(c)y(c) _ -aiP(c) - a 0 Q(c) 

2 ! 2 ~ 2 
V'"(c) 1 


a 3 = -gp = g (-P'(c)y'(c) - P{c)y" - Q’{c)y{c) - Q{c)y\c)) 


— g ( ~P\c)a\ + 


aiP(c) 2 + a 0 P{c)Q(c ) 


- a 0 Q'(c) - aiQ(Aj , 


04 = ••• 


and so on. 

Example 8.8. Compute the Taylor expansion about 0 as far as degree 4 for 
the solution of y" — e 7x y' + xy = 0, which satisfies y( 0) = 2 and y'( 0) = 1. * 

Solution. Rearranging the equation, we have y" = e 5x y' — xy. Therefore 

y"’ = e 5x y" + 5 e 5 V - xy' - y 

y O) = e 5x y w + 5e 5 x y n + 5e 5 x y n _ xy n _ y , _ y , 

= e 5x y"' + 10 e 5x y" - xy" - 2 y'. 
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Substituting gives 

y"( 0) = eV (0) -0 = 1 

y"\ 0) = e°y"(0) + 5e°y'(0) - 0 - 2/(0) =l+5-2=4 
2 / (4) ( 0 ) = e°y'"{ 0) + 10eV(0) - 0 - 2y'(0) = 4 + 10 - 2 = 12 


Therefore, 


x 2 4x 3 12x 4 

S = 2+I+ 2! + ^t + tt 

1 o 2 , 1 4 

= 2 + a: + -a; 2 + -a: 3 - -x 4 ■ 


0 


Example 8.9. Find the series solution for y" + (a; + 3) y' — 2y = 0, where 
2 /( 0 ) = 1 and y'( 0) = 2. * 


Solution. Rearranging the equation, we have y" = — (a: + 3) y' + 2y. Then 


2/"(0) = - (0 + 3) 2/(0) + 22/(0) = -3 • 2 + 2 • 1 = -4, 

2/" = - y’ - (x + 3) y" + 2y' = - (x + 3) y" + 2 /', 

2/'"(0) = -32/"(0) + 2/(0) = (-3) (-4) + 2 • 1 = 12 + 2 = 14, 


Therefore, 

i 4x 2 14cc 3 34x 4 

y = 1 + 2x -— + — 4j- + "- 

= 1 + 2a; — 2x 2 + ^ x 3 — H-• 

In this case, since the coefficients were polynomials, it would have been possible 
to achieve level 2, (although the question asked only for a level 1 solution). 
However even had we worked out the recursion formula (level 2) it would have 
been too messy to use it to find a general formula for a n . 0 
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8.6 Level 2: Finding the recursion relation 

Example 8.10. Consider ( x 2 — 5x + 6) y" — 5 y' — 2y = 0, where y( 0) = 1 and 
y'( 0) = 1. Find the series solution as far as a; 3 and determine the lower bound 
on its radius of convergence from the recursion formula. * 


Solution. We have 

OO 

2 y = ^2 

n—0 

OO OO OO 

5 y = ^2 5 na n x n ~ 1 = ^2 5 (n + 1) a n +\X n = ^2 5 (n + 1) a n +\X n , 

n—0 n—0 n—0 

OO OO 

6 y" = E ( n ~ 1) cL n x n ~ 2 = E 6 ( n + 2) (n + 1) a„ +2 a: n , 

n—0 n—0 

OO OO 

5 xy" = ^2 ( n — 1) inX n ~ 1 = ^2 ^ ( n + 1) na n+ ix n , 

n— 0 n—0 

oo 

x 2 y" = ^2 n(n — 1) a n x n . 

n= 0 

Therefore, 


OO 


E 

71=0 


/ n(n — l) a n 
—5 (n + 1) na n +i 
+6 (u + 2 ) (n + 1 ) a n +2 
\ -5 (n + 1) a„+i - 2 a n 


\ 


00 ( 6 (n + 2) (n + 1) a„ +2 \ 

E —5 (n + 1) (n + 1) a n I x n , 
n=0 \ + (n 2 - n - 2) a n J 


so it follows that 


6 (n + 2) (n + 1) a n+2 - 5 (n + l) 2 a n+1 + (n + 1) (n — 2) a n = 0, 
5n+l In — 2 

«n+2 = V • ~^ a n+l ~ 77 ' —Z a n- 

6 n + 2 6 ?r + 2 

With a 0 = 2/(0) = 1 and ai = y'(0) = 1, we have 

5 1 _ 1 -2 _ 5 2 _ 7 

6 ' 2 Ql ~~ 6 ' ~T a0 ~ 12 + 12 “ 12’ 

52 1-1 _ 5 7 1 1 _ 35 6 ^ 41 

6 3 6 ~3“ 01 ^9'l2 + 6'3^108 + 108 _ 108' 


a 2 = 
03 = 


, 7 2 41 

y=l +X+ X + —X 


12 


108 


Therefore, 
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Notice that although we need to write our equation in standard form (in 
this case dividing by x 2 — 5x + 6 to determine that 0 is an ordinary point of 
the equation), it is not necessary to use standard form when computing the 
recursion relation. Instead we want to use a form in which our coefficients are 
polynomials. Although our recursion relation is too messy for us to achieve 
find a general formula for a n (level 3) there are nevertheless some advantages 
in computing it. In particular, we can now proceed to use it to find the radius 
of convergence. 

To determine the radius of convergence, we use the ratio test R = 1/ \L\, 
where L = linin^oo (a„+i/a„), provided that the limit exists. It is hard to prove 
that the limit exists, but assuming that 

a „+2 5 n+1 1 n — 2 a n 

n + 2 6 n + 2 n n _(_r 

1 1 _ 5 11 

~6'Z _ 6~6'Z' 

So 6 L 2 = 5L — 1, and solving for L gives L = 1/2 or L = 1/3. So R = 2 or 
R = 3. The worst case is when R = 2. Therefore, the radius of convergence is 
at least 2. Theorem 8.3 also gives this immediately. 0 


«n+l 6 

taking the limit gives 



Example 8.11. Consider ( x 2 — 5cc + 6) y" — 5 y' — 2y = 0. Find two linearly 
independent series solutions y± and y 2 as far as a; 3 . * 


Solution. Let yi(x) be the solution satisfying t/i(0) = 1; y((0) = 0 and let 1 / 2 ( 3 ;) 
be the solution satisfying y 2 { 0) = 0; y' 2 {U) = 1- Then y\(x) and y 2 (x) will be 
linearly independent solutions. We already computed the recursion relation in 
Example 8.10. For yi{x), we have oq = y{ 0) = 1 and ai = j/(0) = 0. Thus, 



5 

1 

1 

/ 2 s 

\ 

1 

a 2 = 

6 ' 

' 2 ai “ 

6 

h. 

1 ao = 

6’ 


5 

2 

1 

1 

5 


03 = 

6 ' 

3 a2 ~ 

6 ' 

'3 ai 

" 54 



x 2 


Therefore, 


5 
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For y 2 , we have ag = y( 0) = 0 and aq = y'(0) = 1, so 

5 12 5 

a 2 = — • -a i-an = —, 

“ 6 2 2 u 12’ 

_52 / 1 \ _ 5 2 5 1 _ 25 6 _ 31 

as - g • ga 2 - ar - - • - • — + — - — + — - —. 


Therefore, 


With 


5 o 61 , 

® = X+ i2 X +108 1 + 


, 7 , 41 , 

y = 1 + x + —x +—x 


Looking at the initial values, the solution y(x) of Example 8.10 ought to be 
given by y = yi+y 2 , and comparing are answers we see that they are consistent 
with this equation. 0 


Summarizing: Let p be a regular point of the equation 

y" + P(x)y' + Q{x)y = 0, (8.3) 

Let D be the distance from p to the closest singularities of P or Q in the complex 
plane. Then Equation (8.3) has two linearly independent solutions expressible 
as a convergent power series a n ( x ~ p)" with \x — p\ < D. Theorem 8.5 

guarantees that the radius of convergence is at least D , but it might be larger. 

Given ao = y(p) and a± = y'{p), to find a n , we have a n = y^ n \p)/n\. We 
can find as many a„’s as desired, but in general we cannot find the formula. 
Since we have y" = —P{x)y' — Q(x)y, it can be differentiated to give y"'{p) 
and higher derivatives can be found by further differentiation. Substituting the 
values at p gives formulas for the a n ’s. 

In the special case where P{x) and Q(x) are polynomials, we can instead 
find a recurrence relation. From the recurrence relation there is a chance to get 
the formula for a n (if so, then there is a chance to actually recognize the series). 
Even without the formula, we can determine the radius of convergence from the 
recurrence relation (even if P{x) and Q{x) are not polynomials, we could at 
least try to get a recurrence relation by expanding them into Taylor series,but 
in practice this is not likely to be successful). 
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8.7 Solutions Near a Singular Point 

A singularity a of y" + P(x)y' + Q{x)y = 0 is called a regular singularity if 
(x — a) P(x) and (x — a ) 2 Q(x) are analytic at x = a. To simplify notation, we 
assume that a = 0 (we can always change the variable by v = x — a to move 
the singularity to the origin). We assume that x > 0. For x < 0, we substitute 
t = —x and apply below to t. 

Our primary goal in this section is to consider the Method of Frobenius. We 
look for solutions of the form 


y — x (cto T a±x T • • • T a n x T * * *) — ci^x ci\x -t~ • * • T a n x T • • • 

for some a, where a o yf 0. Then 

y' = a\ax a ~ 1 + a\ (a + 1) x a + ■ ■ ■ + a n (a + n) s Q+n_1 + • • • , 
y" = aia (a — 1) x a ~ 2 + a\a (a + 1) x“ _1 + • • • 

+ a n (a + n) (a + n — 1) x a+n ~ 2 + • • • , 

xP{x) = p 0 + PiX H-1- p n x n H-, 

x 2 Q(x) = qo + qix + -1- q n x n H-. 

So if x ^ 0, then 

aoa (a — 1) x a ~ 2 + a\ (a + 1) ax a_1 + • • • + a n (a + n) (a + n — 1) x a+n ~ 2 + • • • 

+x a ~ 2 (a 0 a + ai (a + 1) x + ■ ■ ■) (p 0 + piX H-h p n x n + • • •) 

-\-x a 2 (a 0 + cl\X + • • • + a n x n ) (<7o + q\X + • • • + q n x n + •••) = 0. 

We have 

a 0 a (a — 1) + a 0 ap 0 + a 0 q 0 = 0, (0) 

ai (a + 1) a + a\ (a + 1) p 0 + a 0 api + a 0 qi + aiq 0 = 0, (1) 

(n) 

Note that Equation (0) implies 


a (a — 1) + apo + qo = 0, 
ot 2 + {po - 1) a + q 0 = 0. 


(8.4) 



98 CHAPTER 8. POWER SERIES SOL UTIONS TO LINEAR DIFFERENTIAL EQ UATIONS 


Equation (8.4) is known as an indicial equation. Solving for a gives us two 
solutions. Then Equation (1) gives di in terms of do, Equation (2) gives d 2 in 
terms of di, etc. We will get the solution y = aoX a (*). Other a gives a second 
solution y = boX@ (*). The plan is to find a n from Equation (n) for n > 1. 
Equation (n) looks like 

(*) a n + (*) a , n -1 + ••• + (*) do = 0 , 

where the coefficients are in terms of a,po,... ,p n ,qo,... ,q n - There is one pos¬ 
sible problem: what happens if the coefficient of a n is zero? Note that 

y" + P{x)y' + Q(x)y = y" + xP(x)— + x 2 Q{ x)\, 

X X A 

so we have 

z 00 

y" + xP(x) — + x 2 Q(x) = Y a n (a + n) (a + n — 1) x a+n ~ 2 
x x z ' 

n—0 

oo 

+ (po + Pi x + P2X 2 -) ^2 «n (a + n) x a+n ~ 2 

n—0 

00 

+ (q 0 + qix + q 2 x 2 H-) ^ a n x a+n ~ 2 . 

n—0 


In Equation (n), the coefficient of a n is 

(a + n) (a + n — 1) + p 0 (a + n) + q 0 . 


Suppose that 

(a + n) (a + n — 1) + p 0 (a + n) + q 0 = 0. 

Let /3 = a + n. Then 

P {P ~ 1 ) + PoP + Qo = 0 

is the indicial equation again, i.e., (3 is the other solution to the indicial equation. 
We conclude that if two solutions of the indicial equation do not differ by an 
integer, the method of Frobenius provides two solutions.* If the two solutions 
do differ by an integer, then the larger one will give a solution by this method, 
but the smaller one may fail. 

Let F{ A) = A (A — 1) + pq\ + qo. Suppose the solutions to F( A) = 0 are r 

*This includes the case where the solutions are complex, i.e., in this case, we get a complex 
solution z = x a+ib (co + c\x + •••), so y\ = Re(ir) and 7/2 = Im( 2 :) give two real solutions. 
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and r + k, where k £ Z + . Given fix ), set 

L{f){x) = f"{x) + P{x)f{x) + Q{x)f(x). 

Let w = a n x n , where a n is to be chosen. For any given a, we have 

OO 

L(x a w) = ^ c n x a ~ 2+n , 

n—0 

where c n = F(a + n)a n + (*) a n -1 + ••• + (*) oo- Chose ao = 1. Then for 
n > 1, we can always solve c n = 0 for a n in terms of its predecessors unless 
F(a + n) = 0. Provided that a ^ s — 1, s — 2,..we have F(a + n) ^ 0 for any 
n, so we can solve it. Suppose that we call the solution a n (a), i.e., ao(a) = 1 for 
any a and a n is chosen to make c n = 0 for this a. Set W (a, x) = a n(ce)x n . 

Then 

OO 

L{x a w(a,x )) = J2 c nX a ~ 2+n = c 0 x a ~ 2 . 

n—0 

But since c n = 0 for n > 0 by the choice of a n (a), we have 

L{x a w{a,x)) = F{a)x a ~ 2 . 


Since F(s ) = 0, yi(x) = x s w{s,x ) is the solution to the DE. We now need 
a second solution. Unfortunately, we cannot set a = r since our definition of 
a n {a) depends on a / s (positive integer). Instead, set 

L{x a w{a,x)) = F(a)x a ~ 2 


and differentiated with respect to a. Note that for g{a,x ), we have 


d_ 

dx 


{Lg) = L 


dg_ 

dx 


since differentiation with respect to x commutes with differentiation with respect 
to a (cross derivatives equal). Therefore, 


L (x° In (x)w(a, x) + 

V da 


F'(a)x a 2 + F(a)x a 2 ln(a:). 
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But note that 


a = s => L ( ln(a;)a; s to(s, x) + X s ( ^ 

' ' da 


k o 

f „\ ™s—2 , 2l 




= F'(s)x s 2 + F(s)x s 2 ln(x) 
= fcr 8 " 2 . 


If A; = 0, then 

y- 2 = In (x) y\ 

is the second solution to our DE. 

If k > 0, consider 


dw 

da 


L x r ^ a n x n j = L x r ^ i 


r+n-2 


n —0 


n—0 


where a„’s are to be chosen and c n = F(r + ri)a n + ■ ■ ■. We have Co = F(r) = 0, 
where r is the root of the indicial equation. Select ao = 1 and inductively choose 
ai,..., a n such that ci,... , c n = 0. With this choice, we have 


L x r ^2 a n x n J = ^2 c n x r+n 2 = c k x s 2 + ^2 c «(+ 


,r+n—2 


n—0 


n—k 


n—k-\-l 

where c k is independent of the choice of a k - Set A = Ck/k. Then 


L x r ^2 a nX n — A 


n —0 


/ dw 

y 

\ da 

Ot — s/ - 


- E 


c„x 


r+n—2 


n=k +1 


k -1 


( ( CL\X + • • • + CLk— \X 

dw 

a k ~ A — 
oa 


| + ^2 a n x n ~ Aln(x)y 1 (x) 

y n=k -\-1 


= E 


r+n—2 


n=k +1 


J 


The choice of a k does not matter—we can choose any. Then inductively solve 
for afc+i, afc+ 2 , • • • in terms of predecessor a*’s to make c n = 0 for n > k. This 
gives a solution to the DE of the form 


2/2 


= x r ^2 a nX n — A\w(x)y\(x). 


n —0 
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We conclude that if 0 is a regular singularity, then there are always two 
linearly independent solutions (converging near 0) 

OO OO 

yi = x s ^2 a n x n , y -2 = x r '^2 Kx n + B(ln(x))yi, 

n —0 n =0 

where r and s are the two solutions to the indicial equation. We have 5 = 0, 
unless s = r + k for some k € {0,1,2 ,...}. 

Example 8.12. Solve 4 xy" + 2 y’ — y = 0. * 

Solution. Let y = J2^ =0 a n x a+n . Then 


y l = ^ (a + n) a n x a+n 1 , y" = ^ (a + n) (a + n — 1) a„;r 

n—0 n—0 

Our differential equation now becomes 


a-\-n —2 


4 (a + n) (a + n — 1) a n x a+n 1 + ^ 2 (a + n) a n x a+n 1 — ^ a n x a+n = 0, 


n—0 


n—0 


n—0 


yy [4 (a + n) (a + — 1) + 2 (a + n)] a„:r a+ ” 1 — a n -ix a+n 1 = 0. 


n —0 

Note that 


n—1 


4 (a + n) (a + n — 1) + 2 (a + n) = 2 (a + n) (2a + 2n — 2 + 1) 

= 2 (a + n) (2a + 2n — 1). 


Therefore, 

OO 

2 a (2a — 1) a 0 ;r Q_1 + [2 (a + n ) (2a + 2?i — 1) — a n _i] x a+n_1 . 

n—1 

Therefore, the indicial equation is 2a (a — 1) =>■ a G {0,1/2} and the recursion 
relation is 

2 (a + n) (2a + 2n — 1) a n — a„_i = 0 


for n > 1. 

For a = 0, we have 

2 n (2 n — 1) a n — a n _i = 0 a n 


1 

2n (2n — 1) " 1 
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Thus, 


a\ = j-ao, 


° 2 = 4^ ai = 4! a °’ 


1 1 1 
a " ~ (2n) (2n — 1) a " n ~ 1 ~ 2n (2 n - 1) (2n - 2) • • • “ (2 n)\ 


Therefore, 


, x x 

2/ = :rao(l+- + — + 


. , x x 

- «0 ( 1 + y 

= ap cosh(v / a;) • 


(2 n)' 

„n 

! + • 


(2 n) 


For a = 1/2, we have 

2 (- + n \ (1 + 2n — 1) b n = 6„_i 


bn (2 n + 1) (2 n) br 


Thus, 


bi 


1 

3^2 


bo, 



1 

5! 


bo, 


b 


n 


l 

(2 n+l)! 


bo- 


a o- 
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Therefore, 


- 1/2 H 1+ ^ + ■ 

/ , X 3 / 2 X 5 / 2 

=4 + v + v + 

= b 0 sinh ( s/x) . 


(2 n+l)! 

a .(2n+l)/2 

' + (2n+l)! 


In general, however, it is possible to only calculate a few low terms. We cannot 
even get a general formula for a n , let alone recognize the series. 0 

As mentioned, the above methods work near a by using the above technique 
after the substitution v = x — a. We can also get solutions “near infinity”, i.e., 
for large x, we substitute t = 1/x and look at t = 0. Then 


dy dy dt dy f 1 \ 1 dy 2 dy 

dx dt dx dx \ x 2 J x 2 dt dt ’ 

d 2 y _ ^dy _ _)^(fy_dt_ _ 2^dy _ J^dAy { _ l_\ _ 3 dy A d 2 y 

7 O Q 7. O 7.0 7 Q 7. O 7.0 l O I 7. I - k 7.0 * 


dx 2 x 3 dt x 2 dt 2 dx x 3 dt x 2 dt 2 


dt dt. 2 


il + p(l) S +0(1)9 = 0 


p 44- p GK +o G4°' 


Example 8.13 (Legendre’s equation). Find the behaviour of the solutions 
for large x of (l — x 2 ) y" — 2 xy' + n (n + 1) y = 0, where n is a constant. * 

Solution. Let t = 1/x so that x = 1 ft. Then our differential equation becomes 




, .4“ y \ * / .2 “iM , ( , n 

Tt +t dfi “i(“ f *j+" ( " + 1 )!' = tl ’ 


(C - t 2 ) + (2t 3 ^2t+^y) +n(n+l)y = 0, 


ct 2 y 2t dy n (n +1 ) 
dt 2 + t 2 — 1 dt t 4 — t 2 


y = 0. 


We see that we have a regular singularity at t = 0. Therefore, there exists a 
solution y = t a near ^ = 0, or equivalently, since t = 1/x, 


_ JL v A_ 

d ^.a / j.n 
n =0 
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for large x. 


0 


Example 8.14. Find the solutions of y" + xy' + y/x = 0 for positive x near 0.* 


Solution. Let 


Then 


Note that 


y = X<x Y anXn = Y a « x " + “ 

n —0 n—0 


xy 

y 

x 


a n (n + a) x n+a 1 , 

n—0 
oo 

a n (n + a) (?r + a — 1) a; n+Q_2 

n—0 

oo oo 

y> n :r n+ “ = y>„- 2 :r" +a - 2 , 

n—0 n—2 


Y a„a:" +a 1 = ^ a n _iX n+a 2 . 

n—0 n=l 


Indicial equation 
/• s 

ao« (a — 1) = 0, 
aia (a + 1) a + clq = 0, 


(0) 

(1) 


a„ (n + a) (n + a. — 1) + a n _i + a„_ 2 = 0. (n) 

Note that Equation (0) implies that a = 0,1. The roots differ by an integer. 
The largest always gives the solution. For a = 1, Equation (1) implies that 
2ai + do = 0, so a\ = —clq/2. Equation (n) then becomes 


a n (n + 1) n + a n _i 


a n - 2 = 0 


^n—1 Q"n —2 
n(n + 1) 


Equation (2) implies that 


6a 2 = —ao — ai = cio 



ao 

2 


a 2 = - 


ao. 

12 ’ 



8.7. SOLUTIONS NEAR A SINGULAR POINT 


105 


Equation (3) implies that 

(1 1 \ 7 7 

12° 3 = ao {2 + n) =ao U == * a3 = a ° 144’ 

Therefore, 

/ 1 1 2 7 3 \ 

yi =a 0 ^:L - 2® - 12 * + 144* 

As for the second solution, we have 


y = x° (b 0 + b\x + b 2 X 2 + •••)+ Cln(x)yi t 
C 

V = b\ + 2b 2 x H- 1 -yi + Cln(a;) 2 /i, 

x 

y" = 26 2 + 6632 : H--^yi + — yi + — y( + Cln(x)y". 

x* x x 

Therefore, our differential equation becomes 


xy + — = 0 , 
x 


( (2b 2 + 6 b 3 x + 24 b^x 2 H-) - —^yi + —yi + C\n(x)y" \ 


T (b\X T 2b 2 x 2 T • 
-h b\ + b 2 x 


+ Cyi + C\w(x)xy' l 


+ C'ln(a;) — 
x 

\ C 

-■■■)-~^yi 


= o, 


/ C 2 C \ 

I (2b 2 + 6 b 3 x + 24 b 4 x 2 H-)- -yi H-yi ' 

x z x 

+ (& 12 : + 2b 2 x 2 + •••)+ Cyi + —h 6 i + 62 ^ + • • • ^ 


+ Ch\(x)y" + C\w(x)xy' l + CTn(:r) 


V 


= 0 , 


(2 6 2 + 6632 ; + 24642 : 

2 C 

H- 

x 

„2 




144 


, 1 2 7 3 

1 - I+ 4* +36 1 


( 612 : + 2b 2 x 2 


C(I _1 X 2_^3 


144 


+ ( — + 61 + 622 ; + 1 
x 


= 0. 


Looking at the coefficient of x -1 , we have 60 — C + 2C = 0 => C = —bo- 
Note that 61 is arbitrary, so choose bo = 0. Then the coefficient of x° implies 
that 2b 2 + C/2 — 2C = 0 =>■ b 2 = — (3/4) b 0 ; the coefficient of x 1 implies that 
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663 + C/12 + C/2 + C + b 2 = 0=>b 3 = (7/18) b 0 . Therefore, 


v2 = bo [( 1 ^i a;2 + ^ 2 + ---) - hi ^) ( x ~l x2 ~Y2 x3 + m x4 


Example 8.15. Solve x 2 y" — xy' + 10 e x y = 0. * 

Solution. Dividing out by x 2 , we have 

„ y ' , 10 e* 
y — + ^-y = o. 

X x z 

We have a singularity at x = 0. Note that xP(x) = —1 and x 2 Q{x) = lOe* = 
10 J2^=o x n /n\. Therefore, 


y = ^2 anX “ 




/ = y ( a + n ) 1 


*+n—i y 


= ^(a + n)« 


= (a + ?i) (a + n — 1 ) a ra :r 0 


With these components in place, our differential equation becomes 


y; (a + n) (a + n — 1) a n a; a+ " 2 — y (a + n) a n x° 


+ “ E=r E 


^ n\ \ ' 

n =0 / \n—0 


o:+n—2 | _ 


We now have 


: (a — 1 ) oq — «ao + lOcto = 0 . 


Therefore, F(a) = a (a — 1) — a + 10 = 0 => a = 1 ± 3i. For 1 + 3 i, we have 

(a + 1) aai — (a + 1) ai + 10 (ao + ai) = 0, 

F(a + l)ai + 10ai = 0. 

Therefore, 


ai --F^TT) a °-~WT3r) a ° 



8.7. SOLUTIONS NEAR A SINGULAR POINT 


107 


and 


F (2 + 3?) = (2 + 3?) 2 - 2 (2 + 3?) + 10 
= 4 + 12* - 9 - 4 - 6? + 10 
= 1 + 6 i. 


Therefore, 


10 10 (1 - 6 ?) 

ai “ ~TT^ a ° “ “(l + 6*)(l-6*) a ° 


10 - 60* 
1 + 36 


a o 


10 - 60? 
37 


a 0 . 


Also note that 

(a + 2) (a + 1) a ,2 — (a + 2) a >2 + 10 ^ ——f- ci-[ + a, 2 ^J = 0, 


and we have 


, . r . 100- 600? 175 

F{a + 2)(?2 + 10ai + 5(?o — F(oi + 2)(?2 —-~- do H— 

„ ,, 75 + 600. 

— F(a + 2)a 2 H- — -a 0 . 


37 


Therefore, 


and we have 


z = x 1+3i a 0 I 1 - 


75 + 600? 

0,2 ~ 37 F{a + 2) a ° 
10-60? 


37 


But 


p l+3? = xx 3i = xe 3iln( x ) = ^ [ cos ( 3 ^( 2 ;)) + isin (31n(*))] , 


so 


z = aoa;cos(31n(a;)) + ao? sin(3 ln(cc)) 

/ 10 , , ... 60 2 . , ... 60 . . . ,.\ 

+ a 0 (x 2 cos(31n(a;)) - — x 2 sm(31n(x)) + — sm(3ln(a;)) J 

+ ^?a; 2 cos(31n(a;)) — ^?a; 2 sin(31n(a;)) + • • • . 

Oi Ol 
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Therefore, 


/ 

Re (z) = cio 


V 


a;cos(31n(a;)) 

+x 2 I cos(31n(a;)) - — sm(31n(a;))J 
+x 3 [*cos(31n(a;)) + *sin(31n(a;))] 



0 


Example 8.16. Solve xy" + (1 — x) y' — y = 0. 


* 


Solution. Note that 


and 


1 — X 

Po = lim xP( x) = lim x - = 1 

x —»0 x —»0 X 


q 0 = lim x 2 Q(x) = lim x 2 ( — — ) = 0. 


x^O 


x—>0 


Therefore, 0 is a regular singular point. The indicial equation is 

a (a — 1) + p 0 a + q 0 = 0, 
a (a — 1) + a = 0, 
o? — ot T oc — 0, 


a 2 = 0 . 


Therefore, a = 0 is a double root and 

OO OO 

Vi y 2 = ^ b n x n + Cln(x)yi, x > 0. 

n—0 n—0 

To find yi, we have 

OO 

y = ^2 a ™ xn > 

n—0 

OO OO 

y' = nan®" 1 = ^2 ( n + a «+i a;n ’ 

n—0 n—0 

oo 

y" = ^ (n + 1) rur” -1 . 

n—0 
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Therefore, our differential equation becomes 

xy" + (1 - x) y' - y = 0, 

OO 

y, [(n + 1) na n+1 + (n + 1) a n+1 - na n - a n \ x n = 0. 

n—0 

From this, we have 


(n + 1) na n+1 + (n + 1) a n+ 1 - na n - a n = 0, 

(n + l) 2 a n+ 1 = (n + 1) a n , 

&n 

a n +1 ^ — 7- 

n +1 


Therefore, 


a 0 ai a 0 a 2 a 0 

ai "T’ a3 -y-3!’ 


a n = 


So we have 


V = a o y “T = aoe 

' n! 


n—0 


Immediately, y i = e x . To find yi (see §5.1, p. 57), we have 


->— f P(x ) dx 


2/2 = 2/1 


= e 


2/? 


-, dx = e x 


o-f'Trdx 


o2x 


dx 




o2x 


dx = e x 


0 -(ln(x)-x) 


o2x 


dx 


= e 


e x /x 


dx = e x / - dx , 


which is not an elementary function. 


Example 8.17. Solve ( x 2 + 2x) y" — 2 (a; 2 + 2a; — l) y'+ (x 2 + 2x 


Solution. Let y = YlmLo dnX a+n . Then 

OO OO 

y' = y (a + n) a n a;" -1- ”^ 1 , y" = y (a + n) (a + n — 1) a, 

n =0 n—0 


ao 
n! ’ 


0 


— 2) y = 0.* 


x a+n-2 
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The de then becomes 

( 

n—0 


(a + n) (a + n — 1) a n x a+n + 2 yy (a + n) (a + n — 1) a n x' 


a+n 


-x\ 


n—0 


—2 ^ (a + ?r) a„:r a+ " +1 — 4 yy (a + n) i 


a+n 


n—0 
oo 


n—0 
oo 


+2 ^ (a + n) a n x a+n 1 + ^ a n x a+n+2 + 2 ^ 


a^x 


a+n+1 


n—0 
oo 


n—0 


n—0 


-2E 


a n x 


a+n 


= o, 


n—0 


(a + n — 1) (a + n — 2) a n _ia: a+n 1 

n=l 

oo oo 

+2 (a + n) (a + n — 1) a n a; Q+ " _1 — 2 yy (a + n — 2) a n - 2 X a+n ~ 1 

n—0 n—2 

oo oo 

—4 yy (a + n — 1) a n - 1 x a+n ~ 1 + 2 yy (a + n) a„a; Q+ " _1 


n=l 

oo 


n—0 


+ J 2 a n -- a+n ~ 1 


3*“"" " + 2 yy a„_ 2 a; Q+n 1 - 2 y^ a„_i- Q+n 1 


= 0 , 


n =3 


n—0 


) 


2 X ~ A } j CLn-lX 

n =2 n—1 

[2 (a + n) (a + n — 1) + 2 (a + n)] a n 

yy | + [(a + n. — 1) (a + n — 2) — 4 (a + n — 1) — 2] a„_i I I a: Q+,l_1 = 0, 
+ [—2 (a + n — 2) + 2] a„_ 2 + <+-3 


E 

n—0 


2 (a + n) 2 a n + |^(a + n) 2 — 7 (a + n) + 4 
+ [—2 (a + n) + 6] a„_ 2 + a n _3 


^n—1 


= 0. 


Note that 2a 2 = 0 +■ a = 0, giving us a double root. Therefore we get the 
recursion relation 

2?i 2 a„ + (n 2 — 7n + 4) n n _ 3 + (—2n + 6) u n _ 2 + u n _ 3 = 0. 

Substituting gives 

2ai — 2ao = 0 V a 1 = qq , 

8a 2 — 6ai + 2ao = 0 => 8a 2 = 6ai — 2ao = (6 — 2) ao = 4ao => Oo = -, 

18a 3 + (—8) a 2 + (0) ai + a 2 = 0 =» 18a 3 = 8 • - — 1 = 3 =+- a 3 = -, 

2 0 

32a4 — 8a 3 — (—2) a 2 + (0) ai + a 2 = 0 =+- 32a 3 = 8- - — 2-- — 1= - =+ a 3 = —. 
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If we our intuition leads us to guess that perhaps a n = 1/ n\ be can use induction 
to check that this guess is in fact correct. Explicitly, suppose by induction that 
cik = 1/fc! for all k < n. Then the recursion relation yields 


2 n 2 a n 


n 2 — 7n + 4 2n — 6 1 

(n — 1)! ~*~(n — 2)! (n — 3)! 

—n 2 + 7n — 4 + (2n — 6) (n — 1) — (n — l)(n — 2) 
(«-!)! 

—n 2 + 7n — 4 + 2n 2 — 8n + 6 — n 2 + 3n — 2 
(«-!)! 

2 n 

(n — 1)! 


and so a n = 1/n!, completing the induction. 

This gives the solution yi = 'Y^ =0 x n /n\ = e x . (If we had guessed initially 
that this might be the solution, we could easily have checked it by direct subsi- 
tution into the differential equation.) Using reduction of order, one then finds 
that the solutions are 


yi=e x , y 2 = xe x + 2\n(x) y x . 


0 


8.8 Functions Defined via Differential Equations 


8.8.1 Chebyshev Equation 


The Chebyshev equation is given by 


(l - x 2 ) y" - xy' + X 2 y = 0 


(8.5) 
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of which 0 is an ordinary point. The series solution is guaranteed to converge 
for \x\ < 1. We have 

OO 

y = ^ a nX n , 

n=0 

OO 

y l = y ^na n x n ~ 1 , 

n—0 
oo 

y" = n (n — 1) a n x n ~ 2 = y^ oo (n +2) (n+ 1) a n+2 x n , 

n—0 n—0 

and our differential equation becomes 

OO 

y^ [(n + 2) (n + 1) a„ + 2 — n (n — 1) a n — na n + A 2 a n ] a:” = 0. 

n—0 


From this, we see that 


n (n — 1) + n — A 2 n 2 — A 2 

°” +2 = (n + 2) (n + 1) Un = {n + 2) (n+ 1)°' 


Therefore, 


a 0 = 1, ai = 0, a 2 = ——, 03 = 0, 

a A 2 _ (4 - A 2 ) (-A 2 ) 

“ 4 “ “4.3 ~-4!-’ a5 ~ 0 ’ 


a 6 = 


(16-A 2 ) (4-A 2 ) (—A 2 ) 


6 ! 


«2n — 


^4 (n — l) 2 — X 2 ^ ^4 (n — 2) 2 — A 2 ^) • • • (—A 2 ) 
(2n)! 


ai. 
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Also, 


a 0 = 0, a i = 


04 = 0, 


1 , 


a 5 


a 2 = 0, a 3 = 2 —ai, 

(9 - A 2 ) (1 - A 2 ) 

= -r,- 


fl2n+l — 


((2n-l) 2 -A 2 )--.(l-A 2 ) 

(2n + l)i- 01 


Note that if A is an integer, then one of these solutions terminates, i.e., 
Ofc = 0 beyond some point. In this case, one solution is a polynomial known as 
a Chebyshev polynomial. 


8.8.2 Legendre Equation 


The Legendre equation is given by 

(l — x 2 ) y" — 2xy + A (A + 1) y = 0 (8-6) 

of which 0 is an ordinary point. The series solution is guaranteed to converge 
for | a; | < 1. Expressed as a power series, the equation becomes 

OO 

= [(n + 2) (n + 1) a„+2 — n (n — 1) a n — 2 na n + A (A + 1) a n ] x n = 0. 

n—0 

From this, we have 

n (n — 1) + 2n — A (A + 1) n (n + 1) — A (A + 1) 

Un+2 = (n + 2) (n+1) Qn = (n + 2) (n + 1) ^ 

If A is an integer, then au = 0 for k > A gives the Ath Legendre polynomial. 
Instead, expanding around x = 1 gives 

x 


p{x) 


1 — X 2 ’ 
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Then 

X 1 

Po = lim (x - 1) P(x) = lim —— = 
x —>1 ®—>1 X + 1 2 

A 2 

g 0 = lim (x - l) 2 Q(x) = - lim (x - l) 2 -- = 0. 

x—>l x—>l X z — 1 

Therefore, x = 1 is a regular singular point. The indicial equation is 

a (a - 1) + p 0 a + q 0 = 0, 
a (a — 1) + -a + q 0 = 0, 
a 2 — a + -a = 0, 
a 2 — = 0. 

Therefore, a = 0 or a = 1/2, so the solutions look like 

OO OO 

Vi = Y] a n (x - 1)" , 2/2 = (x - 1) 1/2 ^2 b n (x - 1)” 

n—0 n —0 

for x > 1. 

For a Legendre equation, around x = 1, we have 

p 0 = lim (x - 1) (- 2X ) = 1, 

®->i \ v — x z J 

T ( t ^2 A (A + 1) 
g 0 = Inn (x - 1) —2 --j = °- 

®—>1 X z — 1 

Therefore, x = 1 is a regular singular point. The indicial equation is 

a (a - 1) + p 0 a + q 0 = 0, 
a (a — 1) + a = 0, 
a 2 = 0 . 

Therefore, a = 0 is a double root and the solutions look like 

OO OO 

2 /i = ^ a n (x - 1)" , y 2 = ^2b n (x - l) n + C ln(x - 1) y x 

n—0 n—0 


for x > 1. 
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8.8.3 Airy Equation 

The Airy equation is given by 


// 

y - X y = 0 


(8.7) 


of which 0 is an ordinary point. The solution converges for all x. Expressed as 
a power series, we have 


E [( n + 2 ) ( n + X ) a «+2 - a„- 1 ] x n = 0. 


n—0 

From this, we see that 

therefore. 


On+2 — 


Q"n—1 


(n + 2) (n + 1)' 


a 0 a 0 

a3 "3T2’ 06 -^5’ 

a i 


«3 n — 


a 0 


2 • 3 • 5 • 6 • 8 • 9 • ■ ■ (3n - 1) (3 n) ’’ 

ai 


“ 4 4-3’ “ 3n+1 3 • 4 • 6 • 7 • • • (3n) (3n + 1) ’ 

a~i n n 

a- 2 = ~y~ =0. 0 = a 2 = a 5 = a 8 = • • • . 


8.8.4 Laguerre’s Equation 

Laguerre’s equation* is given by 

xy" - (1 - x) y' + Xy = 0 (8.8) 

of which 0 is a regular singular point. Note that 

p ° = ts, x {-^—)= _1 - 

qo = lim x 2 — =0. 
x^o x 


Applicable in the context of the hydrogen atom. 
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Therefore, x = 0 is a regular singular point. The indicial equation is 

a (a — 1 ) — a = 0 , 
a 2 — a — a = 0 , 
a 2 — 2a = 0, 
a (a — 2 ) = 0 . 

Therefore, a = 0 or a = 2, so the solutions look like 

OO OO 

Vi = x 2 ^ a n x n , y -2 = ^2 b n x n + C ln(x)y! 

n—0 n—0 

for x > 0. 


8.8.5 Bessel Equation 

The Bessel equation is given by 

x 2 y" + xy' + ( x 2 — A 2 ) y = 0. 

We have 

X 

p 0 = lim X = 1, 
rc^O X 

T 2 - X 2 

q 0 = lim x 2 - -~— = —A. 

x — *0 X~ 

The indicial equation is then 

a (a — 1) + a — A 2 = 0, 
a 2 - A 2 = 0, 

(a + A) (a — A) = 0. 

Therefore, a = ±A. If A ^ k/2 for some integer k, then we get 

OO OO 

yi = x x ^ a n x n , y 2 = x~ x ^ a n x n 

n— 0 n— 0 


(8.9) 
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for x > 0. We encounter trouble if A = /c/2. Consider A = 1/2. Then 

OO OO 

Vi = x 1/2 ^2 a n x n , y 2 = x~ 1/2 ^ b n x n + C\n{x)y 1 . 

n —0 

For 2 / 1 , we have 


n—0 


^ = E 


a n x 


n+ 1/2 


n=0 


/ = Ef»+5 


n—0 


2 I a™® 


n—1/2 


= E 

n—0 . 


n + - In--) a n x 


T—3/2 


2 —1/4 


Therefore, the equation a; 2 //" + xy' + (a; 2 — 1/4) y = 0 becomes 


E 


i 


n—0 L 

From this, we see that 


1 


n - -)a n +[n+-)a n + a„_ 2 - -a. 


1 


1+1/2 _ Q 


1 


1 1 


— — + ?i + — — — ] a n + a ra _2 — 0, 


a n _2 

— 2 i 

n z + n 
_ _ a„_ 2 

n(n + 1) 

Therefore, 

ao a2 ao ao / i\n a o 

a2__ 3^2’ a4_ ~5^4 _ 5!’ ° 6 _ 7T’ a2n “ ( ~ 1} (2n + l)b 

Therefore 


00 „2n+l/2 1 00 

yi = E ( - 1} (2n+l)! = 

n— 0 x /v n—0 


„2n+l 


sin(x) 
(2n+l)! “ vf ' 
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Example 8.18. Identify 

°° n 

V= ^j3vn)\ 

n=0 v ' 



* 


Solution. We seek to solve y'" = y. From this, we see that 


A 3 - 1 = 0, 


Therefore, A = 1 or 


(A - 1) (A 2 + A + 1) = 0. 


, -1 ±VT^4 1 , \/3 . 

A =-2- = ~2 ± ~2 U 


Therefore, the general solution is 


y = C\e x + C 2 e x ^ 2 sin [ '^x ) + C 3 e x ^ 2 cos(^-x 


where C \, C 2 , C 3 are arbitrary constants. 


To find Ci, C 2 , C 3 , we note that 


2/(0) = 1, 2/(0) = 0, y"(0)=0. 


Ci + 0C 2 + C 3 — 1, 
Ci + -^~C 2 — 2^ 3 = 

Ci - fc 2 - ^C 3 = 0. 


Therefore, 
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Solving this system, we have 


' 1 

0 

1 

l " 


' i 

0 

1 

l ' 


' l 

0 

1 

i' 

1 

x/3 

2 

1 

2 

0 

~ 

0 

\/3 

2 

3 

2 

l 


0 

V3 

2 

3 

2 

i 

_ 1 

2 

1 

2 

o _ 


_ 0 

2 

3 

2 

l _ 


_ 0 

0 

3 

2 


' 1 

0 

1 

1 " 


' l 

0 

0 

1 " 

3 


' l 

0 

0 

1 

3 

0 

i 

1 

2 

3 

~ 

0 

1 

V3 

0 

0 

~ 

0 

1 

0 

0 

_ 0 

0 

1 

2 

3 - 


_ 0 

0 

1 

2 

3 - 


0 

0 

1 

2 

3 . 


Therefore, C\ = 1/3, C 2 = 0, and C 3 = 2/3, so 


V = 




0 
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Chapter 9 

Linear Systems 


9.1 Preliminaries 


Consider 


where 


dY 

dx 


AY + B, 



y i 

2/2 


such that 


dy i 
dx 


ayi + by 2 , 


^ 2/2 . , 
— = cyi + dy 2 
dx 


We will first consider the homogeneous case where B = 0. 


Only in the case when the entries of A are constants is there an algorithmic 
method of finding the solution. If A = a is a constant, then we know that 
y = Ce ax is a solution to dy/dx = ay. We will define a matrix e A such that the 
general solution of dY/dx = AY is Y = Ce xA , where C = [C\, C%, • • •, C n ] is 
a vector of arbitrary constants. We define e T for an arbitrary n x n matrix T 
and apply T = xA. Indeed, we know that 


e — 1 + t + 


2 ! 


t 3 t 4 

3! + 4! 


Therefore, let us analogously define 



= I 


rp 2 

T H-1- 

2! 3! 



(9.1) 
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We will consider systematically how to compute e T later, but first we consider 
an ad hoc example. 


Example 9.1. Solve 


dY 

dx 


1 1 
0 1 


Y. 


* 


Solution. First, we write 


A = 


1 1 
0 1 


I + N, 


where 


N = 


0 1 
0 0 


so that NI = IN = N and N 2 = 0. Note that 


A" 


Binomial exp. 

(I + NTT 


rn—1 


N- 


r n— 1 


N 2 


n 

n — 1 


IN 


n— 1 


•N" 


= I + nN 


1 n 
0 1 


Therefore, with A" properly defined, Equation (9.1) gives 


A ... 


l l 


1 2 

x 2 

1 n 

= 1 + 


x + 


— —h • * • + 




0 1 


0 1 

2 

0 1 


r 

J2 


n 


2 


1 + X + ~2\ 

■ H- 

-1-2_L 

+ n\ + 

• • • 0 + x + 2^—|- 3 


0 1 + x+£ + --- + ^ + --- 


e x x(i + x + %r + -" + ^r + -”) 


' e x 

xe x 

0 e x 


0 

e x 


Therefore, the solution is 


Vi 


e x xe x 


" C 1 ! ' 


’ Cie x + C 2 xe x ' 

. y 2 . 


i 

o 

0) 

8 


_ C 2 _ 


C 2 e x 



9.2. COMPUTING E T 
that is, 

yi = C 1 e x + C 2 xe x , y 2 =C 2 e x . 
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9.2 Computing e T 

The easiest case to clo is a diagonal matrix. If 



First, we consider the effect of changing bases. Suppose T is diagonalizable, that 
is, there exists a P such that P J TP is diagonalizable. Therefore, T = PDP^ 1 
and 


T 2 = (PDP- 1 ) (PDP 2 ) = PD 2 P _1 . 



124 


CHAPTER 9. LINEAR SYSTEMS 


So in general, we have T” = PD"P 1 . It then follows that 


e T = I + T+ — + ••• + — 


2 ! 

, D 2 

= P[I + D+ — 


n! 


D' 


n\ 


>-i 


= Pe D P 

So if T is diagonalizable, we can compute e T . 


Example 9.2. Compute e T , where 


T = 


4 1 
3 2 


* 


Solution. First note that 


(4 - A) (2 - A) - 3 = 0, 
8 — 6A + A 2 — 3 = 0, 
A 2 — 6A + 5 = 0, 
(A - 5) (A - 1) = 0. 


Therefore, A = 1 or A = 5. For A = 1, we have 


4-1 

1 



a 


0 

3 

2- 

1 


b 


0 


3 

1 


a 


0 


3 

1 


b 


0 



3 a + b 


0 



3 a + b 


0 


We see that b = —3a, so 


a 


a 


i ’ 

b 


—3a 

— a 

-3 
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9.2. COMPUTING E T 


For A = 5, we have 



Therefore, 


1 1 

1 

-1 

1 

1 

-1 

IPI 

3 

1 

“ 4 

3 

1 



What is P? For each eigenvalue A j, we find its corresponding eigenvector 
Vj. Then for P = [vi, V2,..., v„], which is an n x n matrix, we have 
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For Y' = AY, we have 


Y = e Ax C = e PDP lx C = Pe xu P X C 


constant 

xD td — 1/ 


= p 


a Xix 




= [vi,v 2 ,...,v n ] 


„A iX 


o X n x 


oX^X 


= C 1 e AlX v 1 + C 2 e A2X v 2 + • • • + C n e AnX w, 


e 

A n X 


X n x 


where C = P 1 C. 


Example 9.3. Solve 


Y' = 


4 1 
3 2 


Y. 


Solution. First note that 


(4 - A) (2 - A) - 3 = 0, 
8 — 6A + A 2 — 3 = 0, 
A 2 - 6A + 5 = 0, 
(A - 5) (A - 1) = 0. 


Therefore, A = 1 or A = 5. For A = 1, we have 


4-1 

1 



a 


' 0 " 

3 

2- 

1 


b 


0 


’ 3 

1 ’ 


a 


’ 0 " 


3 

1 


b 


0 



3 a + b 


0 



3 a + b 


0 


* 



9.2. COMPUTING E T 
We see that b = —3a, so 


a 


a 


l 

b 


—3a 

— CL 

-3 


For A = 5, we have 


5 1 



a 


0 

2 - 

■5 


b 


0 

-1 

1 


a 


0 

3 - 

-3 


b 


0 



a 

+ b ' 


0 


3 

- 

3b 


0 


We see that a = b, so 


a 


a 


i 

b 


a 

— a 

i 


Therefore, 


and we have 


Y = 


P = 


1 1 
-3 1 


D = 



e x 

o 





O 

e 5x 


£ 



1 1 
-3 1 

C\e x + C 2 e bx 
—3C\e x + C 2 e 5x 


1 0 
0 5 


e x e 5x 


Ci 

C 2 


= Cie x 


1 

-3 


C 2 e 


5x 


that is, 


1 
1 

y-\ = Cie x + C 2 e 5x , y 2 = -3C ie x + C 2 e 5x . 


127 


0 


If T does not have n distinct eigenvalues, computing e T requires greater 
knowledge of linear algebra.* 


Property 9.4 

1 gPAP' 1 _ p e A p-i 

2. If AB = BA, then e A+B = e A e B = 


e B e A . 


MATB24. 
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Proof. Proof is given in MATB24. 


□ 


Corollary 9.6 

We have e T = Pe D e N P 1 (e D and e N can be computed as above). 


Proof. Proof is given in MATB24. □ 

The steps involved in finding P, N, and D are essentially the same as those 
involved in putting T into Jordan Canonical form (over C). 


9.3 The 2x2 Case in Detail 


Theorem 9.7 (Cayley-Hamilton) 

Let p( A) = |A — AI|. Then p( A) = 0. 


Proof. Proof is given in MATB24. 


□ 


The eigenvalues of A are the solutions of p( A) = 0. We now consider three 
cases for the solutions of p( A) = 0. 

Case 1: p( A) has two distinct real roots Ai and A 2 . This is the diagonalizable 
case considered earlier. We find eigenvectors v and w for the eigenvalues Ai and 
A 2 . Let 

p Vi W! 

v 2 w 2 


Then 


p i T p 


Ai 0 

0 a 2 


so 



0 


2 


P" 1 . 


The solution of Y' = TY would be 


’ e XlX 0 


' c\ ' 

0 e X2X 


. ° 2 . 


Y = P 
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in this case. 


Case 2: p( A) has a double root r. Let S = T — rl so that T = S' + rl. Since 
SI = IS, we have 


e T = e s e rI = e s 


e r 0 
0 e r 


Then 


P( T) = 0, 
(T - rlf = 0, 
S 2 = 0. 


Therefore, 

e s = I+ S = I + T-rI = T+(l-r)I 


and 


e T = (T + (1 - r) I) 


Case 3: p( A) has complex roots r ± iq, where q ^ 0. Let S = T — rl so that 
T = S + rl. Then 

r e r 0 

0 e r 


e T = e s 


and 


p( A) = A 2 - 2rA + (r 2 + q 2 ) = (A - r) + q 2 . 


We then have 


P( T) = 0, 
(T - rl) 2 + (gl) 2 = 0, 
S 2 + (ql) 2 = 0, 
S 2 + <7 2 I = 0. 
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Therefore, S 2 — q 2 1 and it follows that 


= I 


_ S 2 S 3 
s + ¥ + ¥ 


+ 2! 3! + 4! 

1 2! 4! 6! 


5! 


q 6 1 

“eT 


■“-Sr 


r 

5! 


= Icos(g) H— sin(g). 


Therefore, 


e T = ( cos(g)I + 


T-rl 


sin(g) 


e r 0 
0 e r 


Example 9.8 (Double root). Solve 



* 


Solution. We have 


p(X) = 0, 


(-3-A) (9-A)+36 = 0, 
—27 — 6A + A 2 + 36 = 0, 
A 2 — 6A + 9 = 0, 
(A — 3) 2 = 0. 


Therefore, A = 3 is a double root and we have Y = e Ax C. For A, the eigenvalue 
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is 3. Therefore, for T, the eigenvalue is r = 3x. Hence, 

e r 0 


Y = (T + (1 — r) I) 


= (Ax + (1 — 3x) I) 


0 e r 

3x o 

3x 


— 3x — 9x 
Ax 9x 

1 — 6x —9x 
Ax 1 + 6x 


0 e 

1 - 3x 0 
0 1 - 3x 

e 3x 0 
0 e 3x 


1 ) 

e 3x 

o 

\) 

o 

e 3x 


e 3x - 6xe 3x 

—9xe 3x 

c\ 

Axe 3x 

e 3x + 6xe 3x 

. . 

Ci (e 3x - 6xe 3x ) - 9C 2 xe 3x 
AC\xe 3x + C 2 (e 3x + 6xe 3x ) 



C\e 3x 

' 1 ’ 

+ Cixe 3x 

’ -6 ’ 

+ C 2 e 3x 

' -9 " 

+ C 2 xe 3x 

' 9 " 


4 


1 


1 


6 


Example 9.9 (Complex roots). Solve 

Y' = 


-1 4 

-1 -1 


Y. 


Solution. We have 


p(A) = 0, 


(—1 — A) (—1 — A) + 4 = 0, 
(A + l) 2 + 4 = 0. 


Therefore, A = —1 ± 2 i. For A, the roots are —1 ± 2 i, so for T, the roots are 
(—1 ± 2?') x, i.e., r = —x and q = 2x. Note that 


T-rl 1 

0 

Ax 


‘ 0 

2 ‘ 

q 2x 

X 

0 


1 

. 2 

0 _ 
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Thus, 


Y = e Ax C 


= cos(2a;)I + sin(2a;) 


cos(2a;) 2sin(2x) 

\ sin(2x) cos(2x) 
e _a; cos(2;r) 2e~ x sin(2x) 

\e~ x sin(2x) e~ x cos(2x) 
C\e~ x cos(2x) + 2C2e~ x sin(2x) 
\C\e~ x sin(2x) + C^e - ® cos(2x) 


0 

2 

) 

e~ x 

1 

2 

I 

o 

) 

1 

o 


e 

-x 

1 

o 


i 

o 

e~ x \ 



\ Ci 1 




0 


9.4 The Non-Homogeneous Case 


The general solution of Y' = AY + B is Y = Y/,C + Y p , where Y;,C is the 
general solution of Y' = AY. Therefore, Y^C = AY;, C for all C, giving us 

Y;, = AY ft , (9.2a) 

and Y p is a particular solution to Y' = AY + B, giving us 

Y^ = AYp + B. (9.2b) 

To find Yp, we use variation of parameters. Thus, we have 

Yp = Y/jV, (9.2c) 


where 


V = 


Vl 

V2 
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To find V, we have 


Y p = Y/,V, 

Y' = Y' h V + Y/jV', 

(9.2a) 


(9.2b) 


AY 


p 


B = AYjV+YJ' = AY p 

(9.2c) 


Y,V'. 


Therefore, Y^V' = B => V' = Yr 1 B. 


Example 9.10. Solve 


Y' = 


Y + 

e 5x 

Jlx 


e 


* 


Solution. As before, we have Ai = 1 and A 2 = 5. Thus, 


Therefore, 


Vi = 


P = 


1-3 


1 1 
-3 1 


V 2 = 


11 


D = 


1 0 
0 5 


and the solution of Y' = AY is Y = Pe Dx C = Y/,C. So we have 

r i 1 1 r j oir „x 

Y h = Pe Dx = 


1 

1 


e x 0 


e x e 5x 

-3 

1 


0 e 5x 


—3e x e 5x 


L 

J L 


j 

L 


j 

1 1 

’ e~ x 

0 


’ 1 

-1 ’ 

1 

|P| 

0 

e~ 5x 


3 

1 

“ 4 


It follows that 


r -U 
■ h 1 


1 

e - x _ e - x 


e 5x 

1 

e 4x - e x 

4 

3e~ bx e~ 5x 


e 2x 

“ 4 

3 + e -3x 


V = 


l e 4x _ e x 

3x- §e" 3x 
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and 


1 

e x 

e 5x 


l e 4x_ e x 

4 

—3e x 

e 5x 


_ 3x~le~ 3x _ 


1 

4 

„5x 


l e 5x _ e 2* + 3xe 5x _ l e 2x 


_3 5x 
4 e 


+ 3e 2a: + 9a;e 5a: - |e 2a: 


1 


1 


3 


1 

16 

+ e" 2x 

4 

+ xe 5x 

4 

+ e 2x 

12 

3 

3 

9 

1 

16 . 


4 . 


. 4 . 


12 . 


Therefore, 


Y = Y h C + Y p 


c ie x 

1 

+ C 2 e 5x 

1 

+ e 5x 

1 

16 


-3 


1 


3 

16 . 



1 


3 


1 

2x 

4 

+ xe 5x 

4 

+ e 2x 

12 


3 

9 

1 


4 . 


. 4 . 


12 - 


where C\ and C- 2 are arbitrary constants. 


0 


9.5 Phase Portraits: Qualitative and Pictorial 
Descriptions of Solutions of Two-Dimensional 
Systems 

Let V : R 2 —> M 2 be a vector field. Imagine, for example, that V (x, y ) represents 
the velocity of a river at the point (x,y).* We wish to get the description of 
the path that a leaf dropped in the river at the point (xo,yo) will follow. For 
example, Figure 9.1 shows the vector field of Y(x,y) = (y,x 2 ). Let 7 (t) = 
(x(t),y(t)) be such a path. At any time, the leaf will go in the direction that 
the river is flowing at the point at which it is presently located, i.e., for all t, we 
have 7 '(t) = V(a :(t),y(t)). If V(F, G), then 

y x 2 


t. 


*We are assuming here that V depends only on the position (x,y) and not also upon time 
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(a) The vector field plot of (t/, x 2 ). 


(b) The trajectories of (j/,# 2 ) 


Figure 9.1: The vector field plot of (y,x 2 ) and its trajectories. 


In general, it will be impossible to solve this system exactly, but we want to 
be able to get the overall shape of the solution curves, e.g., we can see that in 
Figure 9.1, no matter where the leaf is dropped, it will head towards (oo, oo) as 
f —> oo. 

Before considering the general case, let us look at the linear case where we 
can solve it exactly, i.e., V = (ax + by, cx + dy) with 


dx 

— =ax + by, 


or X' = AX, where 


dy_ 

dt 


cx + dy, 


X = 


X 


a b 

, A = 

_ y _ 


c d 


Recall from Theorem 10.12 (p. 157) that if all the entries of A are continuous, 
then for any point (£ 0 , 2 / 0 ), there is a unique solution of X' = AX satisfying 
x(t 0 ) = Xq and y(t 0 ) = y 0 , i.e., there exists a unique solution through each 
point; in particular, the solution curves do not cross. 

The above case can be solved explicitly, where 


X = e At 


£0 

Vo 


is a solution passing through (£q, 2 / 0 ) at time t = 0. We will consider only cases 
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where |Aj ^ 0. 


9.5.1 Real Distinct Eigenvalues 

Let Ai and A 2 be distinct eigenvalues of A and let v and w be their corresponding 
eigenvectors. Let P = (v,w). Then 


P : AP 


Ai 0 

0 A 2 

D 


Therefore, At = P (Df) P 1 and we have 


X = e At 


x 0 

2/o 


= Pe Dt P'' 


*0 

2/o 


= (v,w) 


„Ait 


= (v,w) 


C ie Xlt 

C 2 e x ^ 


0 e 
= C'ie Alt v + C 2 e X2t w. 


0 

\2t 



r a 1 




Different C\ and C 2 values give various solution curves. 

Note that C\ = 1 and C 2 = 0 implies that X = e Al *v. If Ai < 0, then 
the arrows point toward the origin as shown in Figure 9.2a in which contains a 
stable node. Note that 


X = Cie Alt v + C 2 e A2i w = e A2 * (Cie (Al - A2)t v + C 2 w) . 

The coefficient of v goes to 0 as t —> 00 , i.e., as t — > 00 , X —> (0, 0), approaching 
along a curve whose tangent is w. As t —> — 00 , X = e Alt (Civ + C , 2 e^ A2_Al ' |t w), 
i.e., the curves get closer and closer to being parallel to v as t—+ — 00 . 

We have the degenerate case when Ai < A 2 = 0, in which case X = Cie Alt v+ 
C 2 W. 

The case when Ai < 0 < A 2 gives us the phase portrait shown in Figure 9.2b 
in which contains a saddle point. This occurs when | A j < 0. The case when 
0 < Ai < A 2 gives us the phase portrait shown in Figure 9.2c in which contains 
an unstable node. We have 

X = Cie Alt v + C 2 e A2i w = e Alt (Civ + C 2 e (A2 " Al)t w) . 

Therefore, as t —> 00 , X approaches parallel to w asymptotically. 

Note that in all cases, the origin itself is a fixed point, i.e., at the origin, 
x' = 0 and y' = 0, so anything dropped at the origin stays there. Such a point 
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is called an equilibrium point; in a stable node, if it is disturbed, it will come 
back in an unstable node; if perturbed slightly, it will leave the vicinity of the 
origin. 


9.5.2 Complex Eigenvalues 


Complex eigenvalues come in the form A = a ± /ft, where (3 ^ 0. In such a case, 
we have 

X = Ci Re(e At v) + C 2 Im(e At v) , 
where v = p + iq is an eigenvector for A. Then 

e At v = e at e 0it (p + iq) 

= e at (cos (fit) + isin(/ft)) (p + iq) 

= e at (cos(/ft)p — sin(/ft)q + icos(/ft)q + isin(/ft)p). 


Therefore, 


X = e at [(Ci cos(/ft)p — Ci sin(/ft)q) + Ci cos(/ft)q + C 2 sin(/ft)q] 

at fci cos (fit) + k 2 sin (fit) 

k 3 cos (/3t) + ki sin(/ft) 


cos {fit) 


ki 

k3 


+ sin (/ft) 



Note that tr(A) = 2a* So 


a = 0 =>• tr(A) = 0, 
a > 0 => tr(A) < 0, 
a < 0 => tr(A) > 0. 


Consider first a = 0. To consider the axes of the ellipses, first note that 


1 


1 

o 

1 


cos (/ft) 

1 

<N 

<N 


1 

1 

o 

1 


sin (/ft) 


p c 


Recall that the trace of a matrix is the sum of the elements on the main diagonal. 
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Except in the degenerate case, where p and q are linearly dependent, we have 

cos {fit) = c -i p -i x 
sin (fit) 

Therefore, 

cos(/3f) + sin(/3f) = X‘ (P' 1 )* (C" 1 ) 4 C^P x X, 

cos 2 (/3t) + sin 2 {(3t) = X* (P' 1 )* (CT 1 )* C _1 P _1 X, 

1 = X* (P~*) 4 (c -1 ) 4 C _1 P _1 X. 

Note that C = C 4 , so 

cc* = [ c i ^ i r Ci c 2 

[ c 2 -Ci J [ C 2 -Cl 
r 2 = \ c 2 + C 2 0 

[ 0 c\ + cf 

= (Cl 2 + Cf) I. 



Let T = (P -1 / P 1 . Then X*TX = C\ + C| and T = T* (T is sy mm etric). 
Therefore, the eigenvectors of T are mutually orthogonal and form the axes of 
the ellipses. Figure 9.3 shows a stable spiral and an unstable spiral. 
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0 0 




Figure 9.3: The cases for a, where we have a stable spiral when a > 0 and an 
unstable spiral when a > 0. 


9.5.3 Repeated Real Roots 

We have N = A — AI, where N 2 = 0 and A = N + AI. So 

e xt 0 
0 e 

L 

Therefore, 


g A t _ Nt+Atl _ c Nt^AtI 


= e m e Atl = (I + Ni) 


At 


X = e 


At 


Ci 

c 2 


= (I + Nt) 


1 

o 

-to 

< 

1- 


\ Ci 1 

0 e xt 


l 

s 

1_ 


= e xt (I + Nt) 


Ci 

c 2 


Note that N 2 = 0 => |N| 2 = 0 => |N| = 0. Therefore, 


N = 


ni n 2 
ani cm 2 


Also, N 2 = 0 => tr(N) = 0 =t> ni + an 2 = 0. Let 


V = la . 


Then 


n i + an 2 


' 0 " 

a (n i + an 2 ) 


0 


Nv = 
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So Av = (N + AI) v = Av, i.e., v is an eigenvector for A. Therefore, 
X = e xt (I + N t) 


’ Cl ' 

- P xt 

Cl + (niCi + TI 2 C 2 ) t 

_ C 2 _ 


C 2 + ol (n± + n 2 C 2 ) t 


A t 


= e 


At 


Cl 

c 2 

Cl 

c 2 


+ (Tii Ci + n 2 C 2 ) t 
+ (TilCi + ti 2 C 2 ) tv I . 


If A < 0, we have 


as t —> oo. If A > 0, then 


x 

y 

X 

y 


as t —> —oo. What is the limit of the slope? In other words, what line is 
approached asymptotically? We have 

y C 2 + (niCi + n 2 C 2 ) tv 2 v 2 

oo x t^oo C\ + (niCi + n 2 C 2 ) tvi vi 

i.e., it approaches v. Similarly, 

V v 2 
hm — = — , 
t —> —oo x Vi 

i.e., it also approaches v as f —> —oo. Figure 9.4 illustrates the situation. 

We encounter the degenerate case when N = 0. This does not work, but 
then A = AI, so 


At 


X = e 


which is just a straight line through 


' Cl ' 


’ e xt 

0 


' Ci ' 

- P xt 

’ Cl ' 

_ C 2 _ 


0 

e xt 


l 

— 0 

_ C 2 _ 


Ci 

C 2 


Figure 9.5 illustrates this situation. 
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Chapter 10 

Existence and Uniqueness 
Theorems 


10.1 Picard’s Method 


Consider the general first order ivp 

| S = fix,y), 

1 y(x o) = 2/o- 


Picard’s Method is a technique for approximating the solution to Equation (*). 
If y(x) is a solution of Equation (*), then 


/ % dt= l /(tyWMt 

J Xq at J Xq 



giving us 


y = yo + [ f{t,y(t))dt. 

J x 0 

Conversely, if y satisfies (**), then differentiating gives 


(**) 


^ =0 + f(x,y(x)) = f(x,y) 
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and y(xo) = yo + 0 = 2/0 • Therefore, the IVP (*) is equivalent to the integral 
equation (**). 

If p(x) is a function, define a new function P{p) by 

(■ P (P )) (%) = Vo + ( .f(t,p(t)) dt. 

Jx 0 

So a solution to (**) is a function y(x) such that P(y) = y. 

Picard’s Method is as follows. Start with a function y 0 (x ) for which y 0 (x o) = 
Vo- Let 2/1 = P(y 0 ),y 2 = P(yi), ■ ■ ■ ,y n = P(y n -i ), • • and so on. Under the 
right conditions (discussed later), the function y n will converge to a solution y. 
Intuitively, we let y = linin^oo y n . Since y n +i = P(y-n), taking limits as n —> oo 
gives y = P{y)- Later, we will attempt to make this mathematically precise. 

Example 10 . 1 . Solve y' — —y, where y(0) = 1. * 


Solution. We begin with yo(x) = 1. With Xq = 0, j/o — 1, f(x,y) = 
have 


- y , we 


and 


yi(x) = yo + J f(^,yo(t)jdt 

= 1+ f (—1) dt = 1 — x, 

Jo 

V 2 {x) = 2/o+ f f(t, 2/1 (t)) dt 
d xn 


— 1+ - (1 — t) dt = 1 - x +'—, 

./n dj 


and 


2 / 3 ( 2 :) = 1 +/ -(l-t+—)dt = l-x+ — -—. 


x 2 x 3 


So in general, we have 


. . x , , x 

y n (x) = l-x+ —+ ■■■+(-!) —. 


Therefore, we finally have 

y(x) = lim y n (x) = (- 1 )” — • 

n —>00 z ' 77, 


n=0 
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In this case, we recognize the solution as y = e~ x . 0 

Example 10.2. Solve y' = x + y 2 , where y(l) = 1. * 

Solution. Let 2/0(2) = 1. With xq = 1, yo = 1, and /( x, y) = x + y 2 , we have 


/ ai px 

(t + l 2 ) (it = 1 + J [(f — 1) + 2] dt. 


= 1 + 


(t-iy 


+ 2 (t — 1) 


= 1 + 


(z-1) 2 


+ 2 (x - 1) 


— 1 + 2 (a; — 1) + 


(x~lf 


and 


2 / 2 ( 2 ) — 1 + J t + ^1 + 2 (t — 1) 


(i-1) 2 


dt 


= 1 + 2 (a: - 1) + ^ (2 - l) 2 + ^ (x - l) 3 + | (2 - l) 4 + ^ (x - l) 5 .0 


Picard’s Method is not convenient for actually finding solutions, but it is 
useful for proving that solutions exist under the right conditions. 


Theorem 10.3 

If / : X —» R is continuous, where X C R" is closed and bounded (compact), 
then f(X) is closed and bounded (compact). In particular, there exists an 
M such that 1 /( 2 ) | < M for all x € X. 


Proof. Proof is given in MATB43. 


□ 


Corollary 10.4 

Let R be a (closed) rectangle. Let f(x,y ) be such that df/dy exists and is 
continuous throughout R. Then there exists an M such that 

1/(2,2/2) - /(2,2/1)| < M |y 2 - a/i | 

S -V-' 

Lipschitz condition with respect to y 

for any points ( 2 , 2 / 1 ) and ( 2 , 2 / 2 ) in R- 
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Proof. Let R be a (closed) rectangle. Let f(x,y ) be such that df /dy exists and 
is continuous throughout R. By Theorem 10.3, there exists an M such that 


df, x 

N r) 


< M 


for all r £ R. By the Mean Value Theorem, there exists a c £ (yi, y 2 ) such that 

df 

f(x,y 2 ) - f(x,yi) = c)(y 2 - yi). 


Since R is a rectangle, we have (x, c) £ R, so 


df , x 

dy {x - C) 


< M. 


Therefore, \f{x,y 2 ) - f(x,yi)\ < M \y 2 — 2 / 1 1- 


□ 


Theorem 10.5 

Let / be a function. Then 

1. / is differentiable at x implies that / is continuous at x. 

2. / is continuous on B implies that / is integrable on B , i.e., f B f dV 
exists. 


Proof. Proof is given in MATB43. 


□ 


Definition (Uniform convergence) 

A sequence of functions {/„} defined on B is said to converge uniformly to a 
function / if for all e > 0, there exists an N such that \f(x) — f n {x)\ < e for all 
n > N.* 


*The point is that the same N works for all :r’s. If each x has an N x that worked for it 
but there was no N working for all x’s at once, then it would converge, but not uniformly. 
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Theorem 10.6 

Suppose that {/„} is a sequence of functions that converges uniformly to / 
on B. if / n is integrable for all n, then / is integrable and 


/(*) dV 


lim [ f n (x) dV. 
n ^°° Jb 


Proof. Proof is given in MATB43. 


□ 


Theorem 10.7 

Let {/„} be a sequence of functions defined on B. Suppose that there exists 
a positive convergent series ^n°=i a n such that | f n {x) — f n -i{x)\ < a n for 
all n. Then f(x) = lim^oo f n (x) exists for all x G B and {/„} converges 
uniformly to /. 


Proof. Let {/„} be a sequence of functions defined on B. Suppose that there 
exists a positive convergent series a n such that \f n (x) — /„_i(a;)| < a n 

for all n. Let 

fn{x) = fo(x) + (fl(x) - fo(x)) H-h ( fn{x ) - fn-l(x)) 

n 

= fo{x) + Y (fk(x) - fk-l(x)) . 

k =1 


Therefore 


lim f n (x) 

71—> OO 


/(*) 


fo(x) + Y “ fk- iW) 

k =1 


and 

OO OO 

\f{x) — fn(x)\ = Y (fk(x)-fk-l(x))< Y ak<e 

k=n -\-1 k=n -\-1 


for n sufficiently large, since a « converges. Therefore, /„ converges uni¬ 
formly to /. □ 
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10.2 Existence and Uniqueness Theorem for First 
Order ODE’s 


Theorem 10.8 (Existence and uniqueness theorem for first order OpE’s 
Let R be a rectangle and let f(x. y) be continuous throughout R and satisfy 
the Lipschitz Condition with respect to y throughout R. Let ( Xo,yo ) be an 
interior point of R. Then there exists an interval containing xo on which 
there exists a unique function y(x ) satisfying y' = f(x, y) and y{x o) = yo-** 


To prove the existence statement in Theorem 10.8, we will need the following 
lemma. 


Lemma 10.9 

Let I = [xo — a, Xq + a ] and let p(x) satisfy the following: 

1. p(x) is continuous on I. 

2. \p(x) — j/o I < a for all x € I. 

Then J ^ f(t,p(t))dt exists for all x £ I and q(x) = y 0 + f* f(t,p(t))dt 
also satisfies (1) and (2). 

Proof. Let I = [xq — a,x o + a] and let p{x) satisfy the following: 

1. p{x) is continuous on I. 

2. | p(x) — j/o I < a for all x € I. 

Immediately, (2) implies that ( t,p(t )) G R for tel. We have 

I -> R — f —^ R 

t -> 


so / is continuous, hence integrable, i.e., f* o f(t,p(t))dt exists for all x G 
/. Since q(x) is differentiable on /, it is also continuous on I. Also, since 
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< M, it follows that 


\q{x) - 2 / 0 1 


f(t,p(t))dt 


< M lx 


xq\ < Mat < a. 


□ 


Proof (Proof of existence statement (Theorem 10.8)). Let R be a rectangle and 
let f(x, y) be continuous throughout R that satisfy the Lipschitz Condition with 
respect to y throughout R. Let (xo,j/o) be an interior point of R. Since / is 
continuous, there exists an M such that |/(r)| < M for all r £ R. Let a be the 
distance from (xq, yo) to the boundary of R. Since (xo,yo) is an interior point, 
we have a > 0. Let a = min (a,a/M). We will show that y' = /(x,y), where 
y(xo) = yo , has a unique solution on the domain I = [xq — a, xq + a]. 


Inductively define functions (1) and (2) of Lemma 10.9 by yo{%) = yo for all 
x £ I and x 

Unix) = yo + / f(t,y n ~i(t)) dt. 

J Xo 


By Lemma 10.9, the existence of y n -i satisfying (1) and (2) guarantees the 
existence of y n . By hypothesis, there exists an A such that \f(x,v) — f(x,w) \ < 
A \v — tu|, whenever (x, v), (x, w) £ R. As in the proof of Lemma 10.9, we have 


\vi(x) - Vo(x)\ = \yi(x) - y 0 \ <M\x- x 0 | 


for all x £ I. Likewise, we have 


\y 2 (x) - yi(x)\ = 

[ [f(t,yi(t)) - f(t,y 0 (t))]dt 

J Xq 

< 

[ \f(t,yi(t)) - f(t,y 0 (t))\dt 

J Xq 

< 

*+o 

o 

1 

jS 

■3 o t 


< 

/ AM\t — xo\dt 

J XQ 




2 
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and 


I i/3 0) - 2/2 0)1 = 


Continuing, we get 


< 


< 


lf(t,y 2 (t)) - /0 2 /i(f))] eft 


\f(t,y 2 (t)) - f{t,yx{t))\dt 


[ (am A— 

Jxo \ 


xo\ 


dt 


< MA 


2 \X - Xq| 
3! 


\y n {x) - y n - iO)l < 


We have 


2/nO) = 2/oO) + (2/i(0 - 2/o0)) + ( 2 / 2 0) - 2 / 1 0)) H-1- (2/nO) - 2/n-lO)) 

n 

= 2/0 0) + OfcO) - 2 /fc-iO)) • 


fc=l 


Since 


and 


|2/fc0) - 2/fc—10)| < 


MA^a* 

fc! 


™MA k ~'a k _M Aa 

fc! I V e / ’ 


fc=i 

converges, we must have 


A 


lim y n (x) = y 0 (x) + V' (y k 0 ) - 2/fc-iO)) 

77,—KY) z ' 


fe=l 


converging for all x £ I. Therefore, y0) = lim,^,*, y n (x) exists for all x £ I 
and y n converges uniformly to y. 


Note that 


1/0, 2/raO)) -/0> 2/n-l0))l < ^ll/nO) -J/n-l0)l 
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implies that f(x,y n (x)) converges uniformly to f(x,y(x)). With 

Unix) = yo+ f{y, dt, 

Jx 0 

we then have 

y(x)= lim y,i(x) = lim (yo + / f(t,y n -i{t))dt) 
n—*oo n—> oo \ J Xq J 

= 2 / 0 + [ (lim f(t,y n -i(t)))dt = y 0 + [ f(t,y(t))dt 

Jxo ' n_ *°° ' J xq 

implying that y satisfies y'(x) = f(x,y) and y(x o) = yo- 


□ 


To prove the uniqueness statement in Theorem 10.8, we will need the fol¬ 
lowing lemma. 


Lemma 10.10 

If y(x) is a solution to the de with y(x o) = yo, then \y(x) — j/oI < ot. for all 
x £ I. In particular, (x, y(x)) £ R for all x £ I. 


Proof. Suppose there exist an x £ I such that | y(x) — yo\ > a. We now consider 
two cases. 

Suppose x > Xo■ Let s £ inf({t : t > x o and | y(t) — yo\ > a})- So s < x < 
Xq + o> < Xq + a. By continuity, we have 

a = I y(s) - j/o| = \y(s) - y{x 0 )\ = \y'(c ) (s - x 0 )| = \f{c,y(c)) (s - x 0 )| 

S. y ,✓ 

<M(s—x o) 


for some c £ (xo,s). However, 

s £ I ==> s — xq < a => a < M (s — xq) < Ma < a. 


Therefore, 

M (s — xo) = Ma => s — Xo = a => s = xq + a, 

which is a contradiction because we have s < Xq + a. The case with x < Xq is 
similarly shown. □ 

Proof (Proof of uniqueness statement (Theorem 10.8)). Suppose y(x) and z(x) 
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both satisfy the given de and initial condition. Let a(x) 


( y(x ) — z(x)) 2 . Then 


a'(x) = 2 (y(x) - z(x)) (y'(x) - z'(x)) 

= 2 (y(x) - z(x)) (/( x, y(x)) - f(x, z(x))). 


Therefore for all x € /, 


W{x)\ < 2 | y(x) - z(x )| A | y(x) - z(x )| 
= 2 A(y(x) - z(x)) 2 
= 2 Aa(x). 


Therefore, — 2Aa(x) < cr'(x) < 2Acr(x), and we have 
cr'(x ) < 2Aa(x) => cr'ix) — 2Aa(x) < 0 


— 2Ax / / 


(cr'(x) — 2Acr(x)) < 0, cr'(x) = 


d (e 2Ax a(x)) 
dx 


-2Ax, 


e ~“ x a{x) decreasing on I 
~ 2Ax -(x) < e~ 2Axo a{x 0 ) 


e a 
<t(x) < 0 


if x > Xq- Similarly, 
c'ix) > —2 Acr(x) 


cr'(x) + 2Aa(x) > 0 

e 2Ax (< t'(x) + 2Aa{x)) > 0, &'{x) = 


e 2Ax cr(x) increasing on / 


d ( e 2Ax a(x )) 
dx 


e 2Ax a(x ) < 
cr(x) < 0 


e 2Ax °*(x 0 ) 


if x < x 0 - Therefore, a(x) < 0 for all x € I. But obviously, a{x) > 0 for all 
x from its definition. Therefore, cr(x) = 0, i.e., y(x) = z(x). Therefore, the 
solution is unique. □ 
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10.3 Existence and Uniqueness Theorem for Lin¬ 
ear First Order ODE’s 


Here, we consider the special case of a linear DE 


dy 

dx 


a(x)y + b(x). 


Theorem 10.11 (Existence and uniqueness theorem for linear first |arder De’s) 
Let a(x) and b(x) be continuous throughout an interval I. Let Xq be an 
interior point of / and let yo be arbitrary. Then there exists a unique 
function y(x) with y(x o) = yo satisfying dy/dx = a(x)y + b(x) throughout 
I* 


Proof. Let a(x) and b(x ) be continuous throughout an interval I. Let Xq be 
an interior point of I and let yo be arbitrary. Let A = max({|a(a;)| : x € /}). 
Inductively define functions** on / by yo(x) = y o and 

y n +i{x) = yo + / {a(t)y n (t) + b(t))dt. 


Then 


I y n (x) ~ y„-i(x)\ = 


Assuming by induction that 


Md+ I (a(t)y n ~l.(t) +b(t))dt 

jx°x 

-}Kf- f (a(f)j/ n _ 2 (f) +b(t))dt 

Jx 0 

f [a(f) (y n -i(t) - y n -2(t))] dt 


\y n -i{x) - y n - 2 (x )| < A' 


t _2 \x — Xp\ 
(n — 1)! 


**Assuming by induction that y n (t) is continuous, a(t)y n (t) + b(t) is continuous through¬ 
out I and thus integrable, so the definition of y n + 1(#) makes sense. Then y n +i(x) is also 
differentiable, i.e., y f n +i(x) = a(x)y n (x) + b(x ), and thus continuous, so the induction can 
proceed. 
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we then have 

[a(t) (y n -i(t) - y n ~ 2 (t))] dt 


< 


V - 1)! / 


< A' 


^ils-arol 


n\ 


thereby completing the induction. Therefore, 

I Vn{x) - y n -i(x)\ < - 


nl 


where a is the width of I. The rest of the proof is as before. 


□ 


10.4 Existence and Uniqueness Theorem for Lin¬ 
ear Systems 

A system of differential equations consists of n equations involving n functions 
and their derivatives. A solution of the system consists of n functions having 
the property that the n functional equations obtained by substituting these 
functions are their derivatives into the system of equations, and they hold for 
every point in some domain D. A linear system of differential equations has the 
form* 

au(x)yi + a 12 {x)y 2 H-b a ln (x)y n + bffx), 

a 2 i{x)y 1 + a 22 (x)y 2 H-b a 2n (x)y n + b 2 (x), 


dy i 
dx 
dy 2 
dx 


= a nl (x)yi + a n2 (x)y 2 + 
dx 


a nn (x)y n + b n (x). 


We can write the system as 


dY 

dx 


AY + B, 


The point is that yi,y2, • • • ,yn and their derivatives appears linearly. 
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where 



an(x) •• 

■ a ln (x) 


y i(x) 


b i(x) 

A = 

a 2 i(x) •• 

■ a 2n (x ) 

, Y = 

V2(x) 

, B = 

b 2 (x) 


_ a n i(x) ■■ 

• a n „(x) 


_ Vn(x) 


_ b n (x) 


Theorem 10.12 (Existence and uniqueness theorem for linear systqms of n de’s) 
Let A{x) be a matrix of functions, each continuous throughout an interval 
/ and let B(;r) be an n-dimensional vector of functions, each continuous 
throughout I. Let Xq be an interior point of I and let Yo be an arbitrary 
n-dimensional vector. Then there exists a unique vector of functions Y (x) 
with Y(xq) = Yq satisfying 


dY 

dx 


= A{x)Y + B(;r) 


throughout I.* 


Proof. Let A(x) be a matrix of functions, each continuous throughout an in¬ 
terval / and let B(a’) be an n-dimensional vector of functions, each continuous 
throughout I. Let xq be an interior point of / and let Yo be an arbitrary 
n-dimensional vector. 


Let A = max({j|A(a;)|| : x € /}). Inductively define Y 0 (a;) = Y 0 and 
Y n+ 1 {x) + Y 0 + f (A(t)Y n (t) + B(t))dt. 

J Xq 


vector obtained by 
integrating componentwise 
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Then 




[ X [A(t) (Y n ^(t) -Y n _ 2 (t))]dt 

J Xn 


< 


>n-l\t- x o\ 


= A r 


L 0 \ (n-l)! 

\x - x 0 \ n 


dt 


n\ 


where a is the width of I. The rest of the proof is essentially the same as 
before. □ 

Recall Theorem 8.5 (p. 90) restated here as follows. 


Theorem 10.13 (Theorem 8.5) 

Let x = p be an ordinary point of y" + P{x)y' + Q(x)y = 0. Let R be the 
distance from p to the closest singular point of the de in the complex plane. 
Then the DE has two series yi(x) = Y^=o a nX n and y 2 (x) = Y^=ob n x n 
which converge to linearly independent solutions to the DE on the interval 
\x — p\ < R.* 


Proof. Let x = p be an ordinary point of y" + P(x)y' + Q(x)y = 0. Let R be 
the distance from p to the closest singular point of the DE in the complex plane. 

We first claim that if f(z) is analytic at p and R is the radius of convergence 
of /, then for r < R, there exists an M (depending on r) such that 


1 

n! 


f {n) (p) 


M 

< — 
— r n 


for all n € N. To prove this claim, since 


(*) 


oo 1 

E -/>k = m 

n —0 


converges absolutely, let 
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Then 

i/ (n) (p)r" < M, 

TV. 

so Equation (*) holds. Therefore, our claim holds. 

Let w(z) be a solution of y" + P{x)y' + Q{x)y = 0. Being a solution to 
the DE, w is twice differentiable. Furthermore, differentiating the DE gives a 
formula for w'" in terms of w,w',w". Continuing, w is n times differentiable 
for all n, so w has a Taylor series. We now wish to show that the Taylor series 
of w converges to w for \z — p\ < R. 

Since \z — p\ < R , there exists an a such that \z — p\ < a < R. As above, 
find constants M such that 


P(")(p) 


M 1 

— a n ’ n! 


Q (u \p) 


N 

< — 
— n n 


for all n £ N. Let 


A(z) = 


M 


l _ Z "P ’ 


B(z) = 


N 


1 - 


Note that 


A(z) = M i + iZ£ + (iZ£ 
a V a 


z — p 


so 


A{p) = M, 


A'(P ) 


M 

a 


A" ip) 



Similarly, 


Consider 


#)(p) 

B^ n \p) 


if 

= n!— > 
a n 


p (n) (p) 


, N 

= n !— > 
a n 


Q (u \p) 

A(z)y' + B(z)y. 


(**) 
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Let v(z) be a solution of Equation (**) satisfying v(p) = |u?(p)| and v'(p ) = 
|tt/(p)|. In general, w^ n \p) = Ciw'(p) + C 2 iv(p), where C\ and C 2 are arbitrary 
constants depending on P and Q and their derivatives at p, e.g., 

■w" = P(p) w '(p) + Q(p)w(p), 

w'" = P , (p)w'(p) + P(p)w"(p ) + Q'{p)w{p) + Q{p)w'{p) 

= p'{p)w'{p) + P(jp) (P(p)w\p) + Q(p)w(p)) + Q'(p)w(p) + Q{p)w'{p) 

= ( p 2 {p ) + p'(p) + Q(p )) w'(p) + (P(p)Q(p) + Q'ip )) w(p). 

Similar formulas hold v^ n \p) involving derivatives of A and B at p. 


Using |p(”)(p)| < A^ n \p) and |Q^(p)| < B^ n \p) gives |w;( n )(p)| < v^ n \p). 
The Taylor series of W about p is Y^=o a n i z — p) n , where a n = w^ n \p)/n\; 
the Taylor series of v about p is &n ( z ~ p)"> where b n = v^(p)/n\. 


Since we showed that \a n \ < b n , the first converges anywhere the second does. 
So we need to show that the Taylor series of w(x) has a radius of convergence 
equal to a (this implies that the Taylor series for w converges for n — pk , but 
a < R was arbitrary). We have 


M 


N 


v = 


1 - 


z-P 


1 - 


z-p 


V. 


Let u = (z — p) /a. Then 


// 

v = a 


dv 1 dv 
du a du 

d 2 v du 1 d 2 v 
du 2 dz a 2 du 2 ' 


Then we have 


M 1 dv N 


a 2 du 2 1 ^ u a du 1 — u ’ 

, d 2 v , dv 9 
(1 — u) — - 7 T = aM- —I- a 2 Nv. 
du 1 du 

Write v = In 11 ™- Using its first radius of convergence, we have 


v = 7 n u = 7 „ 


z — p 


in / \n 7 / \n 

= —{z~P) =b n (z-p , 
a n 
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which implies that 7 „ = b n a n > 0. Note that 


dv 

du 


d 2 v 
du 2 


y. ri'y n u n 1 = (n + 1) 7 „+i u n , 

n—1 n—0 

adjust indices 


(n + 1) n 7 n+ iu" 1 = yy (n + 2) (n + 1) 7 „ +2 tt n . 

n—1 n—0 


adjust indices 


Now we have 


(1 - u) yy (n + 2) ( n + 1) 7 n+2 it n = yy oM (n + 1) 7n + iw” + yy a 2 N^n 


n —0 


n—0 


n—0 


/ 


V 


yy (n + 2) (n + 1) 7 „ +2 m” 

n—0 
oo 

- yy (n + 2) ( n + 1) 7 n+2 u n+1 


\ / oo \ 

yy (n + 2) (n + 1) 7 „ +2 n" 


n—0 

Therefore, 


n—0 
oo 


- yy (n + 1) n 7 n+ i ii" 


n—0 


yy (n + 2) (n + 1) 7 n+2 w” = [( n +!)(« + aM) 7 „ + i + a 2 lV 7n ] u n , 


n—0 

so it follows that 


n—0 


(n + 2) (n + 1) 7 n + 2 = (n + 1) (aM + n) 7„+i + a 2 N'y n , 


ln+2 — 


aM + n 


“7n+l+ 


a 2 N 7 „ 


n + 2 '“" r± ?r + 2 

7n+ 2 _ n + aM a 2 N 7 n 
7n+i n + 2 n + 2 7 „ + i 

for all n € N. Since 7 n / 7 n+ i < 1, we have 

lim 


Therefore, 


+oo n + 2 7„+i 


lim ^t 2 - = 1 + 0 = 1. 


7n+l 

So by the ratio test (Equation (8.2) of Theorem 8.2, p. 88), the radius conver- 
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gence of 


is a. 


5Z 7 nU n = = K 


n—0 


n —0 


n —0 


Z — p 


= l 


□ 


The point of Theorem 8.5 is to state that solutions are analytic (we already 
know solutions exists from early theorems). The theorem gives only a lower 
bound on the interval. The actual radius of convergence may be larger. 



Chapter 11 

Numerical Approximations 

11.1 Euler’s Method 

Consider y' = f(x,y), where y{x o) = ?/o- The goal is to find y(cc en d)- Figure 
11.1 shows this idea. We pick a large N and divide [cco^end] into segments of 



Figure 11.1: Graphical representation of Euler’s method. 


length h — (a: e nd ~ £o) /N. Then 

y{x i) « y(x 0 ) + y'{x 0 ) (xi - a; 0 ) 
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is the linear/tangent line approximation of y(x i). Set 

Vi = Vo + hf(x 0 , y 0 ) —> 2/1 « f(x i), 
2/2 = 2 /i + hf(xi, 2/1) —> 2/2 « f{x 2 ), 
2/3 = 2/2 + hf { x 2 l y 2 ) —> 2/3 « /(a: 3 ), 


2/answer — yN — 1 T hf(XN—l , 2/.V — 1 ) ' 2/answer ~ /(^end)- 

Example 11.1. Consider y' = x — 2y, where 2/(0) = 1. Approximate y(0.3) 
using a step size of h = 0.1. * 


Solution. First note that Xq = 0. With a step size of h = 0.1, we have 
Xi = 0.1, x 2 = 0.2, X 3 = 0.3. 

Therefore, 

2 /i = 2 /o + hf(x, 0,2/0) = 1 + 0.1 (0 - 2 ) 

= 1 - 0.2 = 0 . 8 , 

2/2 = 0.8 + hf{ 0.1,0.8) = 0.8 + h{ 0.1 - 1.6) 

= 0.8 - 0.1 • 1.5 = 0.8 - 0.15 = 0.65, 
y 3 = 0.65 + hf (0.2, 0.65) = 0.65 + h (0.2 - 1.3) 

= 0.65 - 0.1 • 1.1 = 0.65 - 0.11 = 0.54. 

Therefore, 2/(0.3) « 0.54. 

What about the actual value? To solve the de, we have 
y' + 2 y = x, 

e 2 V + 2e 2 *2/ = xe 2x , 

ye 2x = J xe 2x dx = ^xe 2x - J ^e 2x dx 

= 2 xe 2x ~ ^ e ' 2x + C, 
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where C is an arbitrary constant. Therefore 


y=\x~\+Ce~ 2 *. 


Note that 


y(0) = 1 + C = 1 C = |, 


so the general solution is 


115 

y= 2*-l + i' 


-lx 


Therefore, 


y( 0.3) = 0.15 - 0.25 + -e" 0 6 « -0.1 + 0.68601 « 0.58601, 


so y( 0.3) = 0.58601 is the (approximated) actual value. 


0 


11.1.1 Error Bounds 

The Taylor second degree polynomial of a function y with step size h is given 
by 

y(a + h) = y(a) + hy'{a) + h 

for some z £ [■ a,h\ , where h 2 y"(z)/ 2 is the local truncation error, i.e., the error 
in each step. We have 

.iy"{z) M 2 
h 2 y_ —v —l < _ h 2 

2 ~ 2 

if \y"{z)\ < M on [a,h\. Therefore, dividing h by, say, 3 reduces the local trun¬ 
cation error by 9. However, errors also accumulate due to y n +i being calculated 
using the approximation of y n instead of the exact value of f(x n ). Reducing h 
increases N, since N = (x en d — Xo) /h, so this effect wipes out part of the local 
gain from the smaller h. The net effect is that 

(overall error = global truncation error) < Mh, 

e.g., dividing h by 3 divides the overall error only by 3, not 9. 
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11.2 Improved Euler’s Method 

To improve upon Euler’s method, we consider 

Vn+l y n ftb 

where, instead of using f'(x n ), it is better to use the average of the left and 
right edges, so 

_ f (Xn) T f {Xn +1 _ f(Xn: Vn) T /(^n+1 1 Un+l) 

2 “ 2 ' 

Figure 11.2 illustrates this idea. However, we have one problem in that we do 



Figure 11.2: A graphical representation of the improved Euler’s method. 


not know y n+ 1 (that is what we are working out at this stage). Instead, we fill 
into the “inside” y n +\ from the original Euler’s method, i.e., 

2 (/(xm yn ) T f (x n +i , y n ~h hf {x ni y n ))), 


i.e., 

Vn+l = y n + 2 [f( X n,y n ) + f{x n +l,yn + hf{x n ,y n ))\ . 
This improves the local truncation error from h 2 to ft 3 . 
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11.3 Runge-Kutta Methods 

We again modify Euler’s method and consider 

Un+ 1 = y n h*. 

At each step, for *, we use some average of the values over the interval [y n , y n +i}- 
The most common one is x n A h/2. Figure 11.3 illustrates this idea. Set 


%n 2Cn + h /2 %n +1 — *^n T h 

Figure 11.3: A graphical representation of the Runge-Kutta Methods. 


kri2 — f (%n T 1/n A 2 


1 , 


1. 


fcn 3 = / V" + o hk 


kn 4 = f \X n A -h, y n A -hk 


"3 


Use 


Vn +1 — 2/n T {kn\ A 2A: n2 T 2k n ^ A 3/c n4 ). 


This gives a local truncation error proportional to /i 5 . 
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